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ABSTRACT ' / 

The 1977-78 Massachusetts statewide a^se^sient of 
Career ""and Occupational Development (COD) involved the testing of 
2/238 thirteen-year-olds and 2,201 seventeen-year-olds. The 
assessnent design required developmental activities aised at the 
proda^ftion of (1) customized achievement tests referenced to 
Important COD objectives, (2) student questionnaires designed to 
collect information on individual student and home vaH&bles, and (3) 
J^rlncipal questionnaires designed to collect informatijOn on 
fFCliOol-related i^ariables. A panel of educators, schooiV 
administrators^ and business representatives met to evaluate the 
actual student performance in^ terms of their own **benchmark** off 
desirable achievement. Results were compared on each age^evel and on 
the COD objectives, vhich were organiz)^ in the following areas: job 
characteristics; job requirements; career decision making; basic, 
skills; and attitudes and values. Ba^ed on these comparisons, thia 
panel felt that more emphasis should be placed on teaching career 
decision* making skills to both age levels and out giving 
thirteen-year-olds additional instruction in the kinds of aibilities, 
training, and preparation required for va-riou's/ careers. Overall, the^ 
panel felt that students ai both age levels we^e teceiving sufficient 
instruction in the other areas. (The first four chapters of this 
report contain a summary of the design and methodology of the 
assessment. The remaining seven chapters present a detailed analysis 
of the assessment results. A number of supporting documents appear in 
the appendixes, and a companion document«--CE 019 016--presents a 
complete interpretation and sunmary of the results.) (BH) 
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FOREWORD 



r 



I. ' 

since 1974-75, the Statewide Educational Assessment Program has provided 
Massachusetts citizens with useful information about the quality of 
education in Massachusetts, The results of fotir years of the Assessment 
Program have Informed parents, students, educators, public officials and 
employers ^bout statewide patterns of student performance in such areas 
as writing, mathematics, social studies, science, consumer education and 
career and occupational development. 



During 1977- 
second time, 
the results 



\8i 13- and 17-year-old students were assessed, for the 
in career and occupational development* This report describes 
|>f th1s^5ses*ment and provides information for the first time 
-%n trends in the performance of students in career and occupational 
..development. Readers interested in a detailed^faiterpretation of the 
assessment findings may obtain a copy of the ?}^^^y and Interpretations 
report by contacting either the Bureau of Research and Assessment or one 
of the regional offices of the Department of Education. ^ * . 

Also for the first time, that report provides the reader with some 
interpretation? of the meaning and implications of the assessment findijigs 
through the concentrated Involvement of many educators throughout the 
Commonwealth. To them, and to the many others whose Involvement may not 
have been explicitly acknowledged, ' the Board of Education expresses its 
sincere appreciation. 

Finally, yit should be pointed out that 31 school systems chose to use the 
tests and procedures jdeveloped for the statewide assessment at. the local 
level. I am pleased to report that, overall, these systems found usin'9^^ 
this local option highly beneficial. - • 

It is our feeling that this year's assessment reports should find even 
iwider audiences than 1n the past. I am pleased, therefore, to present 
this year's Career and Occupational Development assessment findings for* 
review by all interested citizens. ^ 



Charles Gri||sby 
Chairperson 
Massachusetts Board 
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OVERVIEW 



• \ 



The Massachusetts Statewide Educational Assessment Program is 
continuing series -of annual evaluations'^of the Ijnowledge. understanding, 
skills, and^ attitudes of Massachusetts public School students. As estab- 
lished by the Massachusetts State Boafd of Education, the purpose of the 
statewide assessment is to: 

•provide citizens, students, parents, legislators, and educators 
with useful and accurate information on the quality of education 
In Massachusetts 

.4)rov1de -state-level decision makers with Infomation necessary for 
setting educational policy ^ j 

. help local school systems set their own objectives by providing 
them with statewide information on patterns of performance and 
attitudes and strengths and weakne^seT-of students ' 

• enable local sqh^ol districts to develop and to Implement their pwn 
assessment practices by rteking^statewide assessment procedures 

available to them ' ^ 

/ 

Since 1974. Massachusetts statewide assessments hajfe been conducted 
In reading! mathematics.' writing, social studies, citizenship, science, 
ecology, consumer education, career and occupational education, foreign 
lanjuages. decision making, and school climate. The 1977-78 assessment 
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marks • stcond lurvty of tha rt^dlng and caraer/odcupatlonal education 



artas. In future years, re|))Bated assessments will be madeMn the other 
learning areas^as well, to examfne ctianges^ In patterns o.f student ^ 
performance. v. 

The 19^^78 a&sessment was conducted by National Evaluation Systems* 



Department of Education (MOE).^ Personnel from both NES and MDE worked 



Inc. (NES) of Amherst. Massachusetts under contract to the Massachusetts 

tment of 
V i 

Jointly on all aspects of the assessment program. Major project components 
Included the development* of the test Instruments, administration of the 
tests; analysis of the data, and dissemination of the results. A tot &l of- 
2«2£|2, 9-year-olds and 2,019 17-year-olds were tested in Reading, while 
2,238 13-year-olds ahd''2,201 17-year-olds were tested in the area of Career 
and Occupational Development (COD). 

In conjunction with the ^^atewide assessment, MDE provided a valuable 
opportunity to local school districts by offering the state's custom- 
designed materials for use In* comprehensive testing of their owh students, 
^l^bc^ districts could contract directly with NES to participate in the 
Local Assessment Option. To preserve the confidentiality of the Local 
Opt4t}n, results were reported solely to the individual districts and not 
to MDE. < " ■ 

This repoA contains a complete description of the statewide testing 
program in the area of Career and Occupational Development. The report 
describes in detail. the design and methodol^y of the program, as well as 
student achievement data generated by the assessmen^'^ This information 
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cm itrvt ii • vilua bit r tsourct to MDE and to othart InttrtiUd In 
datannlning tha strangths and waaknastas of Massachusatti studantt. Qpn- 
sldaratlon of thasa findings may halp In tha davalopmant of aducatlonal 
policy and prlorltlas almad at Improving tha education of studants through- 
out Massachusetts. 

Outline of This Report 

The first four chapters of thl^ report contain a suwnary of the 
design and methodology of the assessment. The remaining chapters present 
a detailed analysis of the assessment results. A •number of supporting 

♦ 

documents appcaf In the appendices following the results chapters. ^ 
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J. • . °- DATA-GATHERIN(j* INSTRUMENTS 

\ '. '■ ,^ ' ^ ■ ■ . • , ■ ' . . 



r I-ntro[ductlQn- ^ • . 



- > design of the assessment required e)ttens3've developmentaf .activ- : 
i ties aimed at' the productiorl.of (1) cjistomized achievement tests of - - 
oexercjses* referenced to .important objectives in Career and Occupational , , 
tJevelopment, {2) *§tudent questionnaijres designed to collect ihformation on 
indivfHuai stiSdeiit and home variables, and (3) principal questionnaires* 
designed to collect information on , school -related variables. These devel^ 
opmental activities were the joint responsibility of MDE, NES, and a COD 
Technical Committee"' compoied^ educators from across the state involved . 
in many aspects.and lev^^ of career education. 



The Achievement Tests 



The first aptivity ^f the Technical^ Committee was the development of 
appropriate instruments with which to measure student achievement in Career 
apd Occupational Development. As in previous Massachusetts assessments, ^ 
objective- reiferenced tests were developed. These are tests designed to 
measure wfezt^s^dents know^nd can do relative t;o specific types of tasks 
rather than aompca>e students) in terms of achievement. Results are reported 
in terms of the percentage of correct responses rather than in normed 
scores such as grade equivalents or percentiles. • . 



' BecaySfe, the^ommittee was interested .fn comparing the achievement of 
the two age groups, ^^ingle test was developed to be administered to both 
l3- and 17-yeac-old$, After a careful review of available materials, the 
committee identified five major objectives and a tbtal of 113 matching test 
que|ttons for inclusion on the test, 'a total of 61 of theise iteirfs had been 
previously used in the 1974-75 Massachusetts assessment of 17-year-olds, 
In addition, 28 items wer^ dr^wn frbm the.materials Of the National'Assess- 
ment of Educational Progress (NAEP). Examination of scores on these items 
permits corjiparisons betweeri current and previous Massachusetts performance, 
and between performance In ^Massachusetts, tp Nation, and the Northea'st 
region. The remaining 24 Items were drawn rrom'tKe NES Item bank/ A copy 
of all test items appears in Appendix A. 



The Objectives 

^ ■ ■ " V ■ ■ 

Each test item was matched to one of the following five COD objectives: 

1. Job Characteristics : knowledge of the characteristics (classi- 
fications, major duties, nature of tasks, and salary) of various 
careers and occupations. 

2. Job Requirements : knowledge of the abilities, training, and 
preparation required or useful for various careers and occupations. 

3. Career Decision Making : knowledge and^^bility necessary to plan 
and implement career decisions. : 
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4 



4. -Basi c Skills : application of basic skills (numerical, comnuni 

V •'^ cations, and* interpersonal), useful in peeking and retain^11g• 
,, ■ . ■ ■ ■ V . ■ 



emplo^nt. 



•5. Attitudes and Val ues: personal attitudes and values contributing 




0 career success. 



Student and Principal Questionnaires * V , 

The purpose of developing student and principal questionnaires was 
twofold: (1) toidentify characteristics of students/and their schools 
that might prove to bear a relationship to achievement and (2) to provide 
a general cha>afcterization of ^udents and schools that,' in itself, might 
prove useful ih policy decisions. Questionnaires, which were designed by | 
the Technical Committee, were administered to all paVticipating students 
and to principals of atl schoolsVnrolling these students. 

^ ' Student questi onnai res f The student questfohnai re itself "'was liriiited 
in length by the allotted adminls^tration. time in the schools. NES worked 
with MDE and the committee .to develop questii^nnaire items. The result was 
the selection of 27 items for 13-year-^lds 'an^ 31 items for 17-year-olds 
including questions asking students about their -gender, grade, spare-time 
and homework activities, career counseling experierffces, parents' jobs, and 
their own aspirations for future schooling and career^ A copy of each 
student questionnaire appears'^an. Appendix B. 
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The questionnaires were printed on the first seven pages of the ■ ' ^ 
response booklet. In order to increase the reliability of the question- 
naire information to the greatest extent possible, a test acfcninlstrator 
'read the student questionnaire aloud and assisted students in answering thg 
^questions wherever necessary., "Stop" instructions separated the^quftstion- 
nalre ■ff'om the test items in the booklet. . » ' 

Principa-1 questionnaires . The principal questionnaire contained 10 

• . • ■ ' ' ' 

\items. The questionnaire elicited principals' perceptions of such things 

as the emphasis in the school curriculum md level of satisfaction with 
student achievement on each COD objective, ways in which to improve career 
education in the school , degree of parental support for the school, and 
average attendance rates. 

A copy of the questionnaire, along -with a return envelope, was mailed 
to the principal.^ every fleeted school. About 93^ of the principals 
responded. A copy of each principal questionnaire appears in Appendix C. 



V C H A P T E R 2 

^' ' SAMPLING DESIGN AND IMPLEMENTATION 



iHtroductlon 

'To increase the reliability of the data collected and to reduce the- - 
impact'' on schools of statewide testing actiyiti^|^ a sampling approach to 
assessment was adopted. A two- stage stratified cluster design, was used to 
select a random sample of students from the population at each age level. 
The sampling planjfor both age groups was based on the actual distribution 
of eighth- and eleventh-grade populations in the 1975-76 school year. 
(Since population pareiieters by age were n'ot available, population by grade 
was substituted, because most 13-year-olds are in the eighth grade, while 
most 17-year-olds are^in the eleventh grade.) ^ 

This section discusses in detail requirements of the Si^impling design, 
the general framework of the sampling plan, and the procedures used in 
determining sample size?. In addition, it presents the procedures for 
implementing sampling of schools and students, as 'well as a description of 

the numbers' of students actually participating in testing activities. 

' \ . 

Requirements of the Sampling Design 

Several requirements were met by the sampling design: 

(1) Each sample is representative of the entire target population in 
terms of the selected stratification variable (region and kind ' 
i|f.ccninunity). \ ^ _j 

- • ■ ■ r ■ . ' 
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(2) The size of each sample drawn is, suffici^tly large to gei- , 
eralize reliably to the performance of all 13- pr* 17-year -old 
Massachusetts studeats, and to that pf students in se^lectpd 
reporting groups. ^ ' 

(3) All public schools in Massachusetts containing students (jf the 
appropriate age are eligible for selection, 

(4) The sample is a.probabflity sample at all stages of the selectiohx 
process; that is, ^ch eligible school has a chance of being 



li in the 
of two 



selected proportional t'o its population, and each studen 
state has a positive chance of being chosen. (The limit 
test sessions per school does*'not pefmit e^TwaZ. probabi 1 i ty of 
selection across students.) , 



(5) , Students are clustered into school buiWihgs and selecti 



on of 



schools occurs before the selection of Individual students from 
within these schools. This requirement incr^ses the efficiency 
and cost effectiveness of testing. • 



General Framework of the Sampling Plan ', 

Two stratification variables were selected for the sampling plan: 
(l)",educatfonal region of the state and (2) kind of community. The map 
below shows thfe division of the stat^into regions. Each region is iden- 
tified in. the, key below the map. The names assigned to each region are 
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for Identification purposes only; each region is comprised of a larger 
area than might b& suggested by its name alone. Tof example, the Boston 
Region contains a number of communitie^utside the Greater" Boston area. 



J 




1 

2 
3 
4- 
5 
6 



Boston Region 
Northeast Region 
Pittsfield Region 
Southeast Region 
Springfield, Region 
Central Mass'. Region 



The four kinds of community (KOC) were defined as follows; 



Big Cities^ conmunities designated as centra^ cities according to 
the 1970 United States Census. Examples^ include Boston, Brockton, 
Haverhill, Holyoke, Lawrence, Worcester. 



• Industrial Suburbs : suburbs of central cities with below-avei^ge 
family income ($16,000) and with more than 205^ commercial and 7% 
industrial land -use. Examples include Cambridge, Chelsea, Me'dford, 
Quiocy, Peabody, Waltham, Lee, Monson. 
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• Residential Suburbs : suburbs of central cl^j^es /other than Boston 
with abovf^average family Income, and 411 nonindustrlal subu^s{(Df 
Boston, Examples Include Arlington, Braintreer^.Friningham,^Soituate4 
Walpole, Andover, Dover, Milton, *Newtop, Chelmsford, .Shrewsbury,; 

^ Wilbraham. . . • 

• Other Cofnnunl|les : resort towjjs-in the Cape Cod 5ml, Berkshire 
areas, nonindustrlal suburbs of cities other than Boston with below- 

^ average family income, towns with below-averiage\fam1ir^come, and 
communiti^ with a population of less than 2,5(50.\ Examples inclu^ 
^arnstable,^hatham, Yarmouth, Stocibridge, Bridgewater, Hadley, 
Oxford, Stoughton, Newburyport, Taunton, Ayer, Kingston, Orange, ^ 

' Webster, Ashfield, Dunstable, Plympton. • . 

• ^ ' ■ ' • - 

According to this stratification plan, schools with similar 
chaj^cteri sties couT? be" grouped together and assigned to one of the 24 
stratification categories which resulted from a crossing of Jthe'two var- 
iables. Table 2.1 diagram^ the samfiling framework. Appendix D contains 
a listing of all Massachusetts school systeiiis, with their respective region 
and kind-of -community identifications. ^ 

Determining the Sample Size 

Introduction . The size of, the sample of students to be'^tested was 

* 

determined on the. basis of (l)'the level of precision desired by MDE in 
making generalizations to the performance of the population as a whole and 
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JABLE 2.1 

Schematic Diagram of Sampling Stratification 



KINO OF COMMUNITY 



Boston 
1. 



Northeast 
2 



Pittsfield 
3 



Southeast 
4 



Springfield 
5 



Central 
Mass. 
6 



Big Industrial Residential Other 
Cities Suburbs Suburbs Communities 
1 2 3 . 4 





ft 

<^ 








• 






1 






• 












— ^ — 1- 






V. 













p- 



of tlije various strati fieSViiporting groups, (2) the size of the total stu-^ 
dent population, (3) the sl\e df 'thT'student population in each stratum, 



and (4) the size of fthe student population in each category of the strata* 

. • - - > • 

Sampling precision . Whenever estimates are to be made about a popuf. 
lation based on data colTected froiti a sample^^those esti|iia'tes 'are subject 
to error. Error is the probable^ifference between the score of the sample 
% and the true score of the population. Sampling precision refers to the 
maximum degree ~bf^error , which will "be tolerated in making generalizations. 
Toleration of a sampl i n^lerror of, .02 (two percentage ^ints), for example* 

would mean the following: if, in a sample of 17-year-olds, an average 

i \ 

of 80% of the items is answered correctly, then the true score of -the . 
population probably lies between 78% and 8.2%. ' 

The above probability statement is made in' educationj« practice at a 
95% confidence level. That is, the true score, "in the above example, is 
expected to lie somewhere between 78% and 82?^for 95 out of 100 samples; 
for 5% of the samples, the true score will lie outside this range. This 
level of confidence is generally considered sufficient for educational 
research. 

The greater the level of precision desired, the greater the number, 
of students that must be tested. A desire for precision must be balanced 
against p^^ntial costs. In general, increasing precision increases the 
cost— defined in terms of both dollars and time (of students, test admin- 
istrators, and clerical-administrative personnel). As the sample size is 
increased, there is a political cost as well, resulting primarily from the 
. increased impact on the activities of participating schools. 



' Based UDon consideration of the foregoing concerns, MD^ adopted a 
v^^leyffi tolerating ^ 2% (two percentage>^oints) error for the 

.total population. Based on the size of \he overall population of students, 

was deterfnined,4(Tat a^sample of 2,200 students at each age level would 

■ ' " if 
be sufficient for these poVposes, Therefore, at least 88 testing sessions^ 

with 25 students per session would be required. In order to allow for' the 

Inevitable attrition of students from those selected to participate, two 

steps were takery to increase the chances of obtain-ing the desired nuifiber of 

students: (1) the number of testing sessions was increased ptm 88 to 96 

^ at each age level, and (2) from six to 12 alternate students were chosen 

for each test session to replace any students absent oi^ the testing date. 

* Size of the student population \n each stratum . The strata of 
interest are regions and kinds of communities. ' Given the total number of 
testing sessions, the allocation of testing sessions to strata was made on 
the basis of the ratio of students in the population of the stratum relative 
to the total eighth- or eleventh-grade population. 

In other words, the 96 testing sessions per age level were assigned to 
strata proportional to the size of each stratum. Tables 2.2 and 2.3 show, 
for 13- and 17-year-olds, respectively, the number of test administrations, 
number of students sampled, and number of students expected to be present 
to take the test in each of the 10 reporting categories. 

Size of the student population in each category of the strata . The 
number of test administrations in each of the 10 reporting gr^ps shown in 
Tables 2.2 and 2.3 were maintained and the final allocation of testing 
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TABLE 2.2 

Distribution of 13-Yaar-Olds Sampled and' 
' Expected to Participate, by Stratum 





. Number of 


Number of 13- Year-Olds 


Reporting Category 


,>Test 
Administrations 


r ■ 
♦Sample 


Expected 
Participation 


REGION: ^ \ 








1: Boston / 
cl Nortnccist" 
3: Pittsfield 
4: Southeast 
5: Springfield 
6: Central Mass. 


25 

20 ■ 
8 

18 

- 10 
^ 15 


775 
- 620 
V 248 
558 
310 
465 


573 
458 
y 183 
413 
229 
344 


KIND OF COMMUNITY: 








1: Big Cities 
2: Industrial Suburbs 
3: Residential Suburbs 
4: Other Communities 


22, " 
> 12 
36 

, , 26 


682 I 
372 ^ 
1116 
80& 


504 
275 
. 823 
596 


• 

TOTAL 

, C — 


. . ■ 

96 


2976- 


2200' * 



o 
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"■^ • TABLf2*3 

Dfstribution of 17-Year-Olcls Sampled and 
I Expected to Participate, by Stratum. 



Reporting Category 


Number of 
Test 
Admirj4strations 


Number of 17-Year-dlds 




Expectecf 
Participation 


REGION: 
















1: Boston 


27 


999 


619 


2: Northeast 


19 


^703 


435 ' 


3: Pittsfield 


8 


296 


183 


4: Southeast V 


'. 17 


629 


390 


5: Springfield 


10 


370 , 


229 


6: Central Mass. 


15 


555 


344 


KINO OF COMMUNITY: 








1: Big Cities 


21 


777 


481 


2: Industrial Suburbs 


12 


444 


275- 


3: Residential Suburbs 


38 


1406 


871 


4: Other Communities 


25 


925 


573 


TOTAL 


96 


3552 


2200 



25 



to each category of the strata (i.e., each cell of Table 2.1) was 
based on the ratio of eighth- or eleventh-graders in the population of the 
cell relative to the total population in that grade. That is', the propor- ' 
tion of all testing sessions assigned to a particular cell corresponded to 
the proportion of eighth- or eleventh-graders (relative to the total in- 
grade' population) contained in the cell. 

However,. due to the need to oversample in cells with ^n unusually 
small population^ the proportional distribution of testing sessions (and, ^ 
therefore, sampled students) was, not exactly equivalent to population 
parameters. Sampling weights, ultimately computed on the basis of the 
actual number of students taking the tests, insure that the average scores 
for the population and reporting groups are correctly estimated from the 
sample scores. 

Table 2. 4, presents the final allocation of testing sessions, for each, 
age level respectively, to the' individual categories of the strata, as well 
as the corresponding population parameters. The top portion of each cell 
shows the number of students in the category population, while thp bottom 
portion shows the number of test sessions assigned. ' * 

Implementation of School Sampling ' f ' - 

Step 1 . The first step in implementing the sampling design was the 
constructibn of a sampling frame— that is, a list of all sampling units 
(in this case, school buildings) in the population to be sampled. A 
sampling frame of all eligible schools was constructed based on information 

26 
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TABLE 2.4 




Olstributldn of Testing Sessions for 13-Year-Olcis across Categories 
• of the Strata, with Corresponding Popula^j on Parameters 

- / , KIND OF COMMUNITY 

Big Industrial Residential Other 
Cities Suburbs Suburbs Cownunltlffs , TOTALS' 
1 2 3 4 



Boston 



Northeast 



2 Pittsfield 



Southeast 
4 



Springfield 



Central 
Mass. 
6 



iTALS 




27 



^ 
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TABLE 2.S 



DlstribJfeion of Testing Sessions for ir-Year-Olds across Categories 
"of the Strata, wijth Corresponding Population Parameters 




Boston 
1 



Northeast 
2 



2 Pittsfield 

CD . 3 
cc 

s 

<J - 

g Southeast 
uj 4 



% Springfiel( 
^ 5 

Q 



Central 
Mass.* 
.6 



* TOTALS 



Big 
Cities . 

. 1 



KIND OF. COMMUNITY 
Indust»^ial Residential Other 



Suburbs 
2' 



Suburbs 
3 



Communities 

■ ' 4 



TOTALS 



5,433 / 
/ ^ 


7,195 / 


13,513 y 

/. \ 14 


•0 / 

y 0 


26,14ry/ 
27 


*2,406 / 


2,^09^/^ 


11,006 y^ 


3,854 / 

y 4 


19,775 
/ 19 


924 


1 


263 y 
y 1 


2»577 / 
/ i 

4 


3,909 / 


^ ■ — 7? 

3,401 X 


►/^ 0 


3,977 

5 


8,315 /' 

y ■ 

y 8 


15,693 
X 17 


^,638 


300 / 


1,360 

2 


3,067 

y 3 


8,365 y/ 
10 


—^13 / 
3 


582 / 
/ 1 


5,495 / 
5 


6,163 


15,053 / 
♦ y 

y ^ 


18,615 / 
/ 


10,731 
/ 12 


35, 614 / 

y 38 


23,976 
y 25 


88,936. y^ 

y ' 96 
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provided by MDE. ' When the Information was updated and verified, each 
school was assigned a region status and a kind-of -community status. 

. Step 2 . Following this assignment, the next step was to divide the 

- . A . ■ 

sampling frame Into separate frames for each stratified category. The 
frame was broken dovm. Into 24 separate lists, one corresponding to each 
of the 24 categories described In Table 2.1. Schools were listed along 
with their es±1niated eighth- or eleve^ith-gjeade enrollment and cumulative 
population totals. , • 

-" . ■ ' . , 

. , ■ . V V . 

Step 3 , The next step vlais to select the schools from the frame for 
di given 'aategdvy . 'This" selection occurred by using the^list of all'^^eliglbl 
schools ana their cumulative student enrollments. The following procedure 
was used:/ 

^1)' The total student population for the category was noted. 

(2) This tcital was divided by tiie number of testing sessions assigned 
._. ' ' ■ ■ ■ . * 

to the category, yielding value X. 

(3) A random number table was used tjo select a Random nimiber between 
1 and X, and the school whose cumulative population intierval 

contained the Xth student was selected. 

■■ • ' 

(4) Value X was added to the random number (and repeatedly^^tOk^l 

succeeding values) until the total number of schools required 

^ . % 

from the category was selected. Each "selection" represented ^ 
■^test session," and a given school could, thereforfe,. be selected 



more' than once, depending on the size of Its enrol ImeJ^t. A 
maximum of tw6\est1ng sessions per schopl was permitted. After 
a school had been selected for two testing sessions, It was elim- 
inated from the list. : , , '* 

this procedure,, implemented separately for each category. Insured, that 
students within a stratum had an equal probability of selection. All esti- 
mates of the performance of the population and respective reporting groups 

were made from properly weighted data. ... 

■ ■ '. .. / , - ,. . , 

Implementation of Student Sampling , 

Introduction . Once the participating schools had been selected, the' 
second stage of the plart was implemented.; In the secorfd stage, students 
were randomly selected from the eligible pool within each selected school. 
This process was repeated sep^arately for each assigned test session. - 
No stratification variablfl^were employed in the student frame. It was 
assumed that, given-the /number of students being sampled, the random 
selection process would generate an acceptably even distribution of males 
and females in the .total sample for each test. , ) » 



Eligibility^ All students at the" appropriate age level were consid- 
ered eligible for testing ex<!0pt for those who were non-English-speaking, 
or who were handicapped (physically, mentally, or emotionally) insuch a 
^ay that they could not respond to the^test> _ 

Procedure . In order to implement the sampling of students, the 
principal of ^ach selected, school received a letter which indicated the . 



number of testing sessions assigned to thi school and requested a roster 
of the names of all students with the appropriate birthdates. Students 
born during the calendar year 1964 were considered eligible for the teSt 
for la-yearrolds; those born between, October 1, 1960 and September 30, 
1961 were considered eligible for the test for 17-year-olds. 

When 100% of the rosters "had been returned and verified, all of the 
Ineligible students were deleted from the .pool for each school. Remaining ^ 
^tudents were numbered sequentially, each student within a school receiv- 
ing a unique number. Then, using a table of random numbers, 25 "Students 
were selected for each testing session assigned to a school. In addition, 
alternates were randomly selected to replace any students who were absent 
on the testing date. v^At the 13-year-old le^, six alternates were 
selected, while at the 17-year-old level 12 alternates weire chosen, since 
attrition rates are known to be higher at the high school level. Because 
17-year-olds were tested In tWo subject areas this year. It was decided 
that any given student could be required to take only one test. Therefore, 
once a student was selected for a test session In one subject area, he/she 
was ineligible for selection in the second area, this constituted selection 
of students without replacement. ; • ^ ':■ ■ ? ♦ 

, If a given school contained less than 25 eligible students, all eli- 
gible' students, were selected. The alternates for each testing session were 
kept, on file,; and the Tist of selectiBd students 'was forwarded to the prin- 
cipal. A separate 11 St was provided for each testing session in the school. 

Principals reviewed the lists and contacted NES if the names of any 
Ineligible students were included. Where necessary, NES staff provided the 



names, of alternates, assigning them In the order of their random selec- ' 
tion. The- student samples were then in' final form and ready for test 
administration. 

Student Participation in Testing 

Table 2.6 provides a sunmary of the number of students participating*- 
In the assessment at each age level. The actual number of participating 
students may be compared to the number expected to participate, -shown in 
Tables 2.2 and 2.^^At both age levels, the total number of participating 
students was ^quite close to the number expected, although the numtjer of 
participants withlh each reporting category was sometimes higher or lower 
than projected. 

■ I . ■ ■ 

Additianal Vocatibnal^ Student Sampling at the- 17- Year -Old Level 

In addition to the students selected as part of the statewide sample, 
306 students were tested for a spe'ci all zed research purpose. The Division 
of Occupational Education gf the MDE requested a comparison of the achieve- 
ment of students enrolled in vocajtional programs 'in regional vocational- 
technical schools with.jthoise enrolled in vocaitional programs in regular and 

.^>regional academic high schools. In order to all bw for valid comparisons 
•> ■ , ' . ' ' '■ , ' ' ■ ■ ■ 

between these two subflrdups, additional test administrations were conducted 

"irTkademic regionalt^ regional vocational schools to increase the sample 

sizes' for these c^nparisons. Data from students in these "oyersampled" 

schdols are not iriluded in the statewide averages presented below." • 



TABLE 2.6 

Number of Participating Students at 
Each Age Level, by Stratum 



Stratum 


Number of 
13-Year-Olds 


Number of 
17- Year-Olds 


* RFRTON* 

1: Boston 
2: Northeast 
'3: Pittsffeld 
4: Southeast 
5; Springfield 
6: Central Mass. 


598/ 
- 444 
^ 204 ^ 
385 
235 
372 


563 

■ 431 

208 * 
375 
•211 
• 413 


* 

KIND OF COMMUNITY: 




1: Big Cftles 
2: Industrial Suburbs 
3: Residential Suburbs 
4: Other Communities 


450f 
342 
847 
599 


381 
289 
943 
588 


TOTAL 


2238 


2201 



CHAPTER S 
DATA COLLECTION AND HANDLING 



Field Contact 

Contact with school and district personnel. Initiated In November of 
1977, was designed to alert local personnel to the assessment and to pro- 
vide detailed Information on both the statewldiB and local phases of the 
assessment. Related activities Included substantial contact with school • 
and district personnel, both by mall and by telephone. 

NES mailed letters to the superintendents of every Massachusetts 
school district describing both phases of the assessment, inviting them to 
participate in the Local Option, and enclosing sample results reports for 
the Local Option. NES. sent follow-up mailings to those districts which did 
not respond in order to ensure that each districted received. th^ infer- 
matlon and had considered Local Option participation. Close cohjact Autos 
maintained throughout the school year with those districts which chose to 
participate in the Local Coition in order to provide direction and assis- 
tance as needed. : 

Fpllowing is a brief description of subsequent contact by NES stsfff 

■ ■ . ■ \ ■ . ■ ;* \ ' ' ■ ■ ■ ■ 

with sghbol and district personnel involved only in the statewide sample: 

■■ . . ' ^ 

(1) Superintendents of all sampled school districts received a 
t ' ..." 

letter outlining the schedule of events and listing by name 
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jQf.test adrfinlstrajtions (constspng of 25 stud€nts"per session) 
needed In each school. * 

'"'^ Principals of all selected schools received a letter^describi^ 

[ ,the assessment program, outlining scl^eduled principal responsi- 

... tfilities, indicating the number of test administrations assigned, 

nand requesting the submisslbn of a roster of all age-'-eligible 

^ students. ' • 

(3) A letter provldlng/the names of selected students for each 

jsting session was mailed to all participating princfpals. The 

)rihc^pals were unged to recheck their rosters to Insure that 
10 ineligible students were listed. 

MY Test administrators then made telephone calls to all partlcipat- 
^ ing principals to-^schedule the assigned testing sessions. Every 
effort was made to accomnodate the scheduling needs, of individual 
schools. ^ 

(5) A letter enclosing^e principal questionnaire and requesting 

its completion wa^ai led to the principals of all schools con- 
^' taining Statewide sample groups. Follow-up letters were sent to 
principals who did not initially respond. 




NES staff made every effort to describe fully the aims and activities 
of the program, to describe with clarity the resportsibilities of school 
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personneVr and to fost^^^^ on with the prog rair throughout the 

contact period, NES encouraged school personnel to call collect- with any 
questions or concerns relative to the assessment. A copy of the corres- 
pondence sent to the participating schools Is Included In Appendix E. 



Test Administration . 



To. IJjnlt^the burdens placed on school personnel, and to standardize 
acfanlnl strati on procedures for the assessment, 17 persons from Massachusetts 
with state teaching certificates and backgrounds in education were hired 
and trained by NES staff to conduct testing in the schools. A test admin- 
istrators' workshop was conducted by the NES staff 'at which administrators 
were thoroughly trained with respect to (1) the research design of the 

♦ 

assessment program; (2) school and student selection procedures; (3) test 

administration; (4) administration of the student questionnaire; (5) class-. 

room procedures (including assembling of students, introducing the tfest, • 

distribution and collation of materials, and handling of common and unusual 

situations; (6) special responsibilities (Including advance telephone calls 

to principals to verify appointments; procedures for cancellation, postr 

ponement, or r^scheduling of testing sessions; and handling of student 

rosters); and (7) field editing procedures. These responsibilities were 

/*• 

described in detail in a test administrators' manual. In addition, test 
adbninistrators were urged to call collect to NES if any special problems 
occurred. . 

Tests were to be administered in the first two weeks of February, 1978 
for 13-year-olds, and during the month of March, 1978 for 17-year-olds.' 



^ * -25- 

ttsting sessions until etrty March. The test tdnlnl strati on procedures 
Mere similar to those used by NAEP but did not Include paced audiotapes 
to accompany the tests. Testing sessions began with a brief explanation of 
the purpose of the test, followed by the administration of the student 
questionnaires read aloud to students. When all students had completed the 
questionnaires.' the directions for a.nswer1ng exercises were read aloud, and 
the studen^then proceeded to answer the test questi ops Independently. 

Ilowing the testing session, test administrators performed a pre- 
liminary edit of testing materials and coded each response booklet with 
a district, school, and student Identification number. At the close of 
each testing period, all materials were returned to NES for fSnal editing, 
qoding, and data processing. 

Coding. Scoring, and Data Processing 

All test booklets were subjected to an In- house- edit at NES, Including 
(1) a check on the coding of student, school, and district Identification ' 
' Information; (2) k check on the completeness of the student questionnaire 
responses; and (3) an edit for stray marks and double responses to the 
multiple-choice questions. 

Following the coding activities. NES staff hand-scored all responses 
to the open-ended exercises according to scoring guidelines provided by the ^ 
National Assessment of Educattonal Progress. Copies of the NAEP scoring 
criteria for each open-ended item appear In Appendix H of this report, the 
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* r«s|g»ont«i "for tach "s tu^tnt fctrt than kiypuriclwS a riS' vertfTid at tht~WES 
offices* and the cards wt re lilted on a data tape for each age level. 

The data tape for each age level contained one record for each student 
completing the test package. This record Included: (1) Inforratlon given 
the student on l;he student questionnaire; (2) the student's responses to 
each of the exercises; (3) a numerical Identification code which permitted 
the rematching of each student record to Its original test document should 
that prove necessary; and (4) the responses on the matching school princi- 
pal questionnaire and stratification Information for the student' » school. 

Prior to data processing, the data tape was scanned for invalid 
entries and updated where necessary. All response data on the data tape 
were entered In raw- score f^u^ and were converted to the percentage fonti as 
needed. Data reduction needs were determined and files were transformed 
where appropriate. Including proper weighting of scores to provide esti- 
mates of the population from sample data. AlVstudent data (tes^N^cores 
and* questionnaire data) were weighted; only principal questionnaire data 
remained unweighted, since sampling was based on general Izlpg to^tudents. 
not schools. 

' ' ' " \ * ' * 

Sampling Weights 

In order to analyze the data for reporting purposes;' sampling weightd' 

• > . ■ - 

were applied to equalize the probabilities of selection In all strata, after 

attrition. As Indicated earlier, the actual numbers of students responding 

to the tests were to be used In the calculation of sampling weights. 
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the j^tutl sampling Mslghts appJIed to the ^trata on the basis of the 
participation d«ta presented earlier. 



The Local Option 

The Local Optlqn phase of the' assessment allowed participating 
districts to examine In 'detail the achievement of their own students In a 
single class or throughout the district by contracting directly with NES. 
Results permitted participating districts to (1) examine students, classes. 

Schools, and the district as a whole; and (2) caM|)iare local achleveeient 

s * ' 

results with those In Massachusetts, the Nation, and the Northeast region. 

/ _ . . - 

IJl^terlals, as well as regional workshops In test administration and, Inter- 
pretation, were provided by MDE through NES. Districts were required to 
pay only a per capita cost for test booklet printing and data processing. ^ 
The Local Option testing was conclucted In the same time period as the 
statewide sample testing. Overlap of schedules facilitated the organization 
and execution of. testing for both phaseis and eliminated some activities for 
those statewide sampled schools that elected to^partlclpate In the Ljpcai 
Option. 

Thirty-one Massachusetts school systems participated In the Local 
Option at one or more age levels or subject areas. The following services 
were provided by' NES to those districts participating In the Local Options 

• training of test coordinators or administrators In te^t administra- 
tion procedures at one of two regional workshops \ 
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TABU 3.1 ~ " — 

Sampling Weights Based on Participation Data 
for l3-Year-01ds 

KIND OF COMMUNITY 



ft 


Big 
< Cities 

1 

i 


Industrial 

Suburbf 
2 


Residential 

Suburbs 
V 3 


Othtr 

Comnunltlts 
4 


Boston 
1 


38,63 


42.55 


46.11 


0 


Northeast 
2 


■ 

43.58 


55.24 


44.69 ' 


59.95 


PUtsfleld 
3 


29.59 


4.60 


4:34 


,28.89 


Southeast 
4 


49.32 


0 . 


47.87 


50.53 


Springfield . 
5 


93.1^ 


5.19 


« » 

29.67 


40.84 

i 


Central Mass. 
6 


46.35 ) 


22.00 


45.55 - 


43.99 



{ 
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TABLE 3.2 

Sampling Weights Based on Participation Data - 
- ' for Jt7-Year-01ds 



Boston 
1 



Northeast 
2 



Pittsfield 
3 



Southeast 
•4 



Big 
Cities 
1 



Springfield 
5 



Central Mass 
6 



KIND OF COMMUNITY 



Industrial Residential Other 
Suburbs Suburbs Communities 
2 3 4 



54.33 


•* 

/49.28 


42.63 


0 


■ 9 . 
' 63.32 


35.84 


45.29 


48.18 


19.67 


,5.80 


10.52 . 


23.22 


43.35 




' 27.43 


53.65 


^ 72.76 


12.00 


20.61 


43,81 ' 


• . 

39.62 

^ — V " 


25.30 


- 37.38 ' 


35.83 
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• delivery aad pick- up of test booklets 

• editing and'scoring of tests and data analysis 

• complete result repiprts as -described be^ 

' ' ' . • ." ' • ' ■■■—■:§ 

— „ — ^-•-ass4^tanee-wHh-4r^ 

y workshops held after results had been returned to the districts 

Twoxoples of each result report produced by NES were provided. The 
reports are listed below. . » , - ' 

• each class: * " ^ ^ 
yy (1) a Student Ob»jective Achievement Report 

- (2) a tlass Item Analysis Report 

(3) a Class Objective Summary Report ' 
«, (4) a Class Questionnaire Report 

• For each school : ' ^' * 

■ ■"■ ■> J ■ . ' .' , ■ 

. ' ■' . ■ . ' ■ - ■ - 

(1) a School Item Ana.lysis Report * 

(2) a School Objective Summary Report 

(3) a School Questionnaire Report, 

• 7 • for the school system: ■ • A 

a School System Item Analysis Report 

• (2) a .Schdol System Objective's^ Report 
(3) _ a School System Questionnaire Report - , 

I. . ■ ■ • _ ■ • ' 

NES made every effort to ensure that the special needs of individual, 
school districts wiere met wherever possible. S^chopls parti< 
Local Optibn may compare their own results with the results for the state 

■ ' ■ . ■ • / 

and the respective groups as given in this report. • * 



Is of individual ' 
;icipatfng' iir^Ww 



ERIC 



42 



m^':y'--^-y--^ ■•. ' • -31 



' 0 H A P T E R 4 
DATA ANALYSIS* AND INTERPRETATION 



Goals of Data Analysis 



. the goals of the data analysis plan developed jointly by staff members 
Of MEsfend MDE Mere (1) to describe the achievement pf students statewide. 



(2) to describe the achtevemfeRt of students in selected re^ofting. groups 
an^^o compare their achievement with that of students statewide, (3) to 
compare the. perfomianc^of students in the 4tate pf Mjk^achuset^s with that 
of the nationwide and Nbrtffeast_samples tested » by the N^^^ Assessment 
•of EducJrtional Progress, (4) to compare the performance of students tested 
in previous Massachusetts assessments to the pferformance of students testeid 



this year, and (5^ to describe selected chiaracterlstics'of students and 
schools statewide and in the .different region's and kinds of communities. 

• All goals were accdmplished'^ the ^ection of appropriate stati s- 
ticar analyses and proper • weighting Of scorfes/ All ach-jevement scores arc 

■'iv"' '■■ ' "' " ' ' ■ ■ ■ ■ ' " ■■ / 

* reported in terms of the percentage of students responding correctly to a 
given test item orpn terms of the average percentage of a a^t of .items 

i answered correctly. » 

' ■ .... . • ■ ' 

Interpretive Activities ^ V 

/For the first time this year, the Massachusetts assessment included an 
additional cpmpohent designed to increase the usefulness of the results. 



< 



Thi^hase focused on generating In terpretat Ions ^and recommendations bas6d 
oh^rofesslonal dudgment of the assessment results. Two actlvltles'^re 




conducte^to assist In thtf Interpretive prpcess. 

"Benchmark Panel . A group of educate^, .school administrators, and 
business rjf(presentat1ves from throughout Massachusetts met to discuss the ' 
assessment results. Their t^ was to evaluate the bciual performance ' 
1n terms of their own "benchmark" of desirable achievement. Given the 
percentage of students answering correcftl/ each test Item^ the Benchmark 
Painel attempted to reach a consensus option on whether or not additional - 
emphasis ought to be placed on teaching students t|;)e skills measured by ^ 
that item. * - 

Iwterpretive ilorkshop ; This COD Technical Committee etiigmented by spoie.-^ 
additional members met at . a two-day workshop to review all of the results 
of the^assessment. Us'Tnitt) their pr<>fesSional judgmeni: and tl^e input of the 
Bienchmark Panel , " th^ g^ierated a set . of 1 nterpreti ve comments ind recota- ' 
mendations for action based on the results. 

The^re^Hs^o^ the Benchiiiark Pm^ discussion ^re sunntari zed in Chap- 
ter 11 of this\report. Specific discussi oris and recbnmendatlons generated , 
by the expanded Technical Committise arie to be found in a separate document 
entitled ."Sumnary and Intei*pretat1ons— Career and« Occupational Deyelop- 
ment," available from MDE. / ^ C . 

Interpretive issues ' -^i. 

All of the analyse^ conducted for the objective-referenced assessment 
involve Jthe computation of the percentage of students answering correctly 



each-Individual test iterti and average percent-correct scores for alF 
Items t«laied to an objective o)- all items on a given test. Additional 
statistics* included for- these analyses are standard errors and tests of 
sfghlflcance of differences between groups. ; •> 

the/dlfferences presented'in th'is report are those which were statis- 

\ ■ ■ : . ■ ■ ■ ■ , , . . 

■ ■ ♦ - ' ' • •. - . 

ticaTly significant at the .05 level. This means that a difference of the 
given magnitude could be expected to occur in repeated samplings 'only five 
times in 100 if, in. fact, there were no differences between groups. While 
the'se results very likely reflect the actual performance differences 
between groups, they should not be used to infer the causes of these dif- 
ferences. For example, it may be shown that students who plan to attend a 
four-year college perform abov^ the state average, but this does not imply 
that thi s char^ieri st i c causes hi gher performance . The di f f erence , or 
relatfonship, niay in fact be "caused" by other, perha^^ unknown, variables. 
' The percent correct reported for the state as a whole and for the 
individual reporting groups are estimates based on probability samples, 
and, as such, have standard errors associated with them. The reported 
differences (effects) in performiance. between a given group and the state 
.average are also estimates and have associaJted. standard errors. The stan- 

dard error of an effect depends on the size ofHhe two samples, the percent 

... V , ■ ■• . 

of each group answering the item correctly, and other stratification and 
clustering effects. Therefore, the magn1 tildes of the standard errors vary 

.... * ■ ■ i ■ . 

'considerably from comparison to comparison. An effect that i^ twice tl 
size of its associated standard error is considered significant at the ; 
level. 
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• lt<^hould be rioted that some rather TargeVrfects are occasionally 
not statlsticaHy significant, while some rather small effects are in some 
Instances significant. This is due to the fact that statisticaV signifl- • 
cance Is determined by the ratio of the effect to its standard error. For 
this reason, the' reader shouldexercise caution In interpreting statis- , 
tically Sfgnmcant dlffer^ces. Stati stical^gnifi cance should ndt be 
equated wi th practltdT Importance or educati onal . meani ngf u1 nels . Jiis t as . 
acceptable levels of performance must be judged on the basis of educational 
expectations, i^he magnitude of differences observed between groups should 
similaicly be judged n^^nly on the basis of statistical significance but 
also on the basis of educational meani ngf ulness 

pe reader should also be careful not to infer causality from the 
differences observed between the performance of Massachuse-Jts students and 
those in the Nation and the Northeast Region. The fact that Massachusetts 
students surpassed the Nation's or the Northeast .Reg ign's students, or 
failed to perform as well.vdoes not necessarily mean that Massachusetts 
school s are "causi ng" the d1 f ference 1 n performance. Olf f erehces 1 n sample 
'composition (e.g., in age, grade, community characteristics, family back- 
ground, and personal characteristics) should be considered as bearing a 
relationship to performance results. , . 



Summary of InterpT^i've Issue's; Focus to J:he Reader 



I 



The achievement scores presented in this report represent best esti- 
mates of the "true" achievement scores i^j^h would -have been obtained -had 
aZZ students in the population, rather than a representative sample, been 



46 



tested. Statistical 'techniques indicate^at these estimates arejnjijt v 
likely Within tiw percentage points of the "true" scores of the population. 
If, for example, the statewide score Is shown as 62% ^ It would l?e safe to 
j s*y that the "true" statewt(S-score^1s-between-6055-and -64?t. — Th e purpo se^f-^ 
this reminder is to caution the reader to refrain from over-emphasizing 

■ • 

small differences between scores. ^ 

In addition, many of the results presented in this..report Involve 
comparisons of scores for various pAjrposes. TheS(fe include comparing 
'Massachusetts scores' wfth nationv/i<5i scores, comparing current Massachusetts 
scores with those achieved in previous assessment years, and comparing 

scores o^yvarious reporting groups within Massachusetts, in each of these 

'.■/.' ^ ' ' ' ■ ' . ■ - • . 

cases, the average /score of one "grpup" is, compared to that of another 

"group," Again, be^au^ the scores were generated' on the basis of a eample 

of students, the score for each group shoulji be considered an estimate of 

the true score of the population that the group reppssen^syCe.g. , all - 

pMtZio aefejoi eleventh-graders). ' 

? The reader should note that the tables in this chaptar indicate those 

differences in scores that are statistically si gntf leant at the .05 level. 

However, statistical, significance is nol^ to b6 equated with. educational 

meaningful ness. Sma^JL^drfferences between groups may be etatistiaatty 

signifihant in one case and not in another due 'to a variety of factors, t^t, 

even Where statistically significant, differences may be too small to be ^ 

educationally meaningful. What is educationally meaningful depends on the 

reader's judgment about the practicaf-impTl cations of given differences in 



Particular attention should paid to the narfatlve, since It Is 
intended to focus the reader on the most outstanding differences between 
groupis;. Where statistical tests have not been performed, the nariratlVi 
genieral ly descrtbe-S€orei~that -vary--t^^^ 

' ■ " ■ ■ . ^ , 

The reader should bear In mind that such small dlffer(^nces are not likely 
to be educationally meaningful. . : V 

Further, the reader Is cautioned to refrain from drawing cause-effect 
Inferences from these data. The differences observed suggest only a 
relationehip betvieen a given factor and achievement, no^ a occueativis 
in/Zwemje of the factor on achievement. 



CHAPTER 5 
ACHIEVEMENT RESULTS FOR.ALL MASSACHUSETTS 



, 13- AND 17-YEAR-OLDS 

4 * 



Introduction ^ 

— — — . , . ^ . • ■• . - - 

• ' ' ■ ) . * ■ ^ ■ 

The purpp$e\of this chapter is to examine the test performance of 
Massachiisetts 13- and lT^ejar-olds. The performance of all students in . ; 
each age group is descrfbjed fop each of the five objectives and for each 
of the items matched to these objectives'. ' » 



Summary of Resul£s^ by Objective ^ ' '] ,' » 

Performance on each objective is giv/en in terms of the average 
>■;■. ■ • ■.^/. 

. percentage of the related test items that the students answered correctly, 

^ If, for example, students at a given age level show an average of 68.2% 
for a particular objective, this means that, on the average, the students 
cortrectly. answered 68.2% of the items assessing that objective. Perfor- 
mance on the objectives is discussed in the narrative below. 

Figure 5.1 displays for each objective the average percentage of 
•matching test items answered correctly by each age group. The reader is 
reminded that the achievement scores presented here represent best esti-^- ^ 
mates of the *'true'* achievement scores which wourld have been obtained had 
aZZ students- in the population, rather than a representative sample, been 
tested. Statistical techniques indicate that these estimates are most ^^ 
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likely iH^lin two percentage p<>1nts Of the "true" scoresvof the population, 
' If, for example, the stat^^ Is shown as 62%, one can feel con- 

f1<Jent .that the*"true" statewide score Is between- 6095 and 6A%. The purpose 
of this reminder' is to caution the reader^ to refrain from over-emphasizing 
small differences between scores. ' 

• Thirteen-year-olds scored between 55.1% and 72.1% correct across the 
five Dbjecttvesv Their lowest performance was on Objective 2, Knowledge 
6f •Job RequlriSmerrts , while their highest performance was oh Objective 4, - i 
Basic Skills. Scores of IT-year-olJs ranged between 66.3* and 83.2% cor- 
rect, with lowest performance on Objective 3, Career Decision Making, and 
highest performance on Objective 4, Basic' Skills.' ' 

On all five objectives, i7-year-t)lds. scored about 10 jsercentage 
points higher than 13-year-olds. At both age level s,\^eE|fonnanc^^ -7. ' 
Objectives 4 and 5^as considerably higher than that ^^|Bl|s^ three 
objectives. 



Summary of Results on Individual Items 



Results on individual Ume are pre^tei^^ted Below. The foil owi 
information is provided for each test' item: 

• the number of the test questloh as it appeared In the test booklet 

• a brief description of the test item ' ^ 





• • the percentage of all students in the age group answering .correctly 



er|c ' V 



' • the percentage answering correctly In each the Hassachusetts 
reporting groups defined by the variables: sex of student, region, 
and kind of comunlty 

• where the question was teSted by NACP, the percentage of students 
A - in the'^Natlon and In the Northeast an^rlng correctly 

• where data Is available, thei)ercenUge of Massachusetts 17-year- 
olds answering correctly during the 1974-75 assessiaent 

Tables 5^2 and 5,3 present th.1s Inforwatlori foir 13- and' 17^year-^olds, 
#espect1 vely . Because the test was the sane for both age 1 evel s , the 
'reader can compare the achleveineat of ' th^. two a^^^ groups by referring to 
Idefitlcal Item numbers on the two tables. ? 

The reader Interested In a detailed analysis of the test fhould . 
examine these tables and Appendix A to gain an Insight into tbe nature of^ 
the ItemjT that weriMii^l^ each Objective; Appendix A contains copies^ 
of al 1 test 1 terns , organi zefl|robject1 ve . For each test 1 tem ; the per- 
centj^ge of|Students selecting each response alternative Is shown. By 
examining this Ihformatlonl the reader can determlne^ot^nly th^ percent- 
age of students answerlr^ correctly, but alsd the percentage selecting 
each of the incorrect responses. . • ' 
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OBJECTIVE 2 (continued) 
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DOJECTIVE 2 (continued) 

A TV REPAIRHAN has. Miitcli of 
Uwse eight cliaracteHstlcs? 

A< HcaPTIONIST has which of 
these et9ht characteristics? 

A DMinSPERSON has which of 
these eight characteristics? 

The program described will 
prepare Jolin to be: ^ 

To prepare for boU^ a police 
officer, Sue shuulVv 

Mliat level of iatlt does being 
a SALES CLERK require? 

What level of Math does being 
an ELECTRICIAN require? 

Uhat level of nath docs being 
an ENGINEER require? 

Miat level of math does being 
a BANK TELLER require? 

Mhat level of nath does being 
a METEOROLOGIST' require? 

flOJECTIVE 3 

List five things to, consider 
when cliuosiMg a career.** 

List five ways to learn more 
t a^^Db^ before taldng it.*' 

!S Diane, have enough sidll to 
cdntlmie with ca))lnet nialcing? 

Should Narren become a nwr-chant 
sea«an? * 
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TABLE 5.2 (continued) 
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OOJECTIVE 3 (continued) 

Uhlch Job Mtcltes l^aren's 
Interests and abilities? 

Toi's plS$t4(gli-sclioo) plans 
(hould Include: 

In 10 years, will we need more 
or fewer HATHEHATICIANS? 

In 10 years. wlU we need more 
or fewer FOilESTERS? 

In 10 yedrs. wlU wo need more 
or fewer BUSlflESS HACIIINE 
REPAIRPERSONS?' 

,ln 10 years, will we need more 
or fewer ELEMENTARY TEAQIERS? 

In 10 years, will we n^ed More i 
or fewer COMPUTER PROGRAHNERS? 

In 10 years, will we need uore 
or' fewer LAB TECHNICIANS? 

In 10 years, will wo need nore 
or fewer ELECTRICAL ENGINEERS? 

In 10 years, will we need mor^ 
or fewer SECKETARIES? 

OBJECTliff * 

A Job muwe is: ' 

Miat sliould you do about the 
Mi^Ukos Tod wade? 

UliQW should you tell abuiit tlie 
lack.of safety e<)ui|)tiiGiK7 

To have a yoiMl job intcrvlewi 
you should be on tlitic. T or FY 



4 



Percenlaye of Students Answering Correctly 



Massachusetts 



All 



29 
35 
53 
46 
67 

48 
74 

70 
69 
31 

24 
66 



Sex 



N F 



30 27 
37 " 34 

53 53 

48 44 

67 68 

45 50 

76 72 

69 6B 

30 32 

23 24 

71 80 

68 G5 
86 91 



Region 



1 2 < 3 4 5 6 



22 28 33 27 

29 36 38 36 

54 49 ' 55 52 

43 44 53 '4^ -^2.^JO-H9'"5r"46 50 



30 20 22 27 ^8 ^30 
34v 33 39 30 31 37 
51 54\57 55 52 53 



67 66 ^ 72 59 69 

48 50 48 46 47 48 

^ 68 79 79 72 77 

67 68 75 71 69 75 

69 65 73 71 65 71 



29 32 29 37 25 29/ 



20 22 24 20 24 23^ 

75 76 74 76 77 77 

65 64 70 67 6,9.68 

86 87 93 91 87 93 



Klnd of Coanunlty 



12 3 4 



62 70 70 66 




60 73 71 69 

36 27 31 30. 

'li 30 27 17 

68 76 76 78. 



t 



66 67 66 
85 88 90 91 



Nation 



TABLE 5.2 (continued) 



\ ' 


'■ . . ' 












Percentage of students Answering Correctly 




:"lt«i 


Oo»cript1on of Itm 












Massadiusetts 










HAEP . 


■■■ 










Region 






Kind of Coiinunlty 






All 






















H 


f 


I 


2 


3 


4 


5 


6 


1 2 


3 


4 


Nation 


Northeast 




OOJ^CTIVE 4 (continued) 






























(7 


To iMVft • good Job interview, 
you slwuld speak only wlien 
askod 1 question. T or F7 


56. 


52 


60 


58 


57 


57 

•If 




56 


83 


111 QU 


w 


90 




■ i. 


68 


To have a good Job Interview, 
you sliould answer the questions 
acturately. T or F7 


90 


88 


92 


89 


90 


95 


89 


90 


: 90 


82 91 




90 


'4, ■ ■ 


,« 1 


69 


To have a good Job Interview, 
you should sliow interest in tlie 
joui ,1 or rf 


90 


87 


93 


89 


88 


91 


91 




93 


. 86 91 
/ 


92 


91 






u 


Mikh <}uo)tlon should you ask 

Jlral UUriiqi 0 jvU IlllOrVIClii 


69 


61 


76 


68 


71 


76 


78 




70 


63 , 68 


73 


67 






n* 


(fcir ttvtiph: How piaiiy trees were 
piflriiGU On Neuiiesaayr 


91 


91 


90 


90 


93 


91 


92 


92 


88 


85 m 


94 


91 


95 


97 


79* 


Oui' (Sruph: How iiany trees 
piaiiieu on inursuayr w 


75 


74 


76 


70 


74 


78 


?7 


76 


70 


64 77 


80 


75 


80 


83 


80* 


ftii* GiKiifhi How many trees; were 
pianicu on rriuoyr — 


21 


,22 

\ 


21 


20 


'•22 


28 


'20 


27 


20 


IS 20 


26 


20 


35 


40 


81* 


According to tiie blueprint, liow 
long is tlie office at Side X7 


63 


68 


59 


60 


64 


68 


62 




68 


45 61 


73 64 


59 




82* 


According to the Itlueprint, liow 
long Is tlie office at Side V7 


56 


60 


53 


54 


57 


64 


S3 


58 ' 


60 


39 57. 


58 




81/ 
82* 


VtiViient af aludento auimriiiQ 
QuotttioHO H AlfU 81i om'aathj. 


49 


55 


43 


46 


50 


53 


46 


48 






59 


48 


53 


62 


IN , 


nLkuiuiiiy lu-iiH! uiucpniiL, now 
Many square feet of floor space 
are tliere in Uio office? 


CJ 


2/ 


21 


01 

ii 




25 


20 

I 


29 


25 


12 21 • 


?^ 


23 


27 


. 34 


89A* 


On ttie envelope, write In the 
return uanie. 


91 


86 


95 


?l 


90 


94 


92 


89 


92 


84' ' 92 


.93, 


93 


94 


93 


890* 


On llie envelope, write In Uie 
return street, 


91 


87 


95 


91 


90 


95 


93 


90 


92 


84 93 

1 


513 


94 


92 


93 



ERIC 



59 



•■ is: 



to:". 



•TABLE 5.2 (continued) 



-.1 

1. 

it... ' 



89£* 

m* 

90 

92 
93 



2S 
.62 
63 

65 > 



DoScHpliofl of Uor: 



CDJeCIIVE 4 (continued) 

On tilt enviloiHi. write In the 
ritum city, state, and zip. ^ 

On tlio envc1o|ie. write 1» llie 
•Jdircsseo's nawo. 

Dn the eqvetopo. write In the 
addressn's street. 

On the envelope, write In the 
addressee's city, state, and 
zip. 

IViivnmt of atiklanta ocmiloting 

According to tlieitable.'wliat' 
size socks shouPyou buy if 
yuu wear Size 10 sliocs? . 

In a phone boc|, "Jones* would 
lie found bctwe|n which 2 iianic|7 

Mliidi would bejleas^ wdniMhlte 
to discuss at tjic meeting? 

OOJCCTIVE 5 ^ . ' 

Uliose fault was/'lt tliat liary 
did not buy lh(&>read7 

lo be a succesSjJ^liQ&ld a nurse 
^t aloiifj wcllidth others? 

To be a success. \shou1 d a niirse 
sicflf ice speed |or accuracy? 

To be a success, Ishou Id a nurse 
cjiaitgo Jobs yearly? 

To be a Hccessf^should a nurse 
^offcr iiew idea: 



All 



91 



94 



94 



94 



89 



79 



n 



53 



30 



n 



84 



89 



51 



Sex 



H' F 



87 95 

90 90 

90 91) 

90 9? 

83 95 

76 01 

75 80 

51 55 



33 2H 

71 73 

80 87 

86 92 

54 49 



Perccnlaye of Students Answorini) Correctly 



Massachusetts 



Region 



\^ L 3 4 6 6 



91 90 95 93 89 93 

93 93 97 96 91 95 

94 93 97 96 09 96 
93 93 96 96 69 96 

t ■ 

89 88 94 90 85 91 

77 79 80 77 77 02 

77 77 fll 80 73 79 

49 54 53 52 50 61 



29 3ri 23 29 30 27 

70 71 78 72 73 75 

82 04 87 84 84 04 

80 89 91 90 90 89 

53 52 51 46 55 52 



Kind of CoNiMunity- 



12 3 4 



84 93 93 94 

87 95 96 96 

88 94 96 96 
88 94 96 95 

01 91 91 92 

65 81 85 79 



71 77 82 77 



38 48 62 55 



22 34 35 26 

70 71 72 74 

74 04 87 86 

83 , 88 91 90 

53 49 !)3: '49 



lalion 



92 
95 
93 
93 



67 



23 



TABLE 5.2 (continued) 



f 



,i 

a 

73 

•1 
107 

m 

109 

no 

( . 

Ill 

112 
113 



IHicrlptlM of 



OWECTIVC 5 (coRtM) 



T« McflM M iccoiNitMti ilmld 
l|M JUiwII In i collijH mUi 
coyntf ,• ■ 

To bicoM M accouotMki iiould 
M dxjirofi NH fdaii ibmt 
r booliMiplRg Job? / 

To Imom m ttcowiUot, ihMild 

cilii^(ii| lior boss? 

To bocoil M iccouHtMt, sliould 
lym bt dopoAdiblo ud 
ooUMitlistlc about hor Job? 

In Iboso cIrcMMtMcoSi illyou 
rtspoiiilblo for tho Injury? 

Is ft liyortint for success to 
ilways try to iiprovo tbliHis? 

Is It li|HMrtMt for success to 
keep your touth shut and iiot 
stir tblngs up7 

Is It important for success to 
loarH lo do your Job better? 

is U i^)ortant for success to 
get along Mil with others? 

is It iM|)ortMt for success to 
keep quiet about your iislakes? 

is it iM|)ortant for success to 
do wrk you can be proud of? 

Is iUiportant for success to 
do omy idiat you are> told? 



, l^rcentage of Students AnsMirIng Correctly 



Niliachusetts 



All 



77 

63 

76 

69 

73 
90- 
49 

92 
80 
75 



20 



Sex 



N F 



76 7^ 

61 64 

73 79 
86 91 

71 75 
90 90 
46 49 

90 94 

80 80 

72 77 f 
79 81 
19 > 20 



Region 



1 2 3 4 S 6 



79 ' 75 , 82 76 80 77 



67 62\ 70 64 67 78 



76 73 82 77 7» % 



87 88 ' 93 90 66 93 
n 73 75 73 73 74 



69 93 90 66 93 



48 51 54 47- 47 48 



90 92 94 93 90 95 



77 81 83 81 76 83 



754«li''")6 75 69 79 



79 78 80 ,84 77. 80. 
21 21 18 17 18 19 



Kiid of Cownlty 



1 2 3 4 



69 78 81 78 

61 6S 62 64 

■. / 

72 79 78 75 
81 8ii 91 92 

64 72 79 72 

61 90 94 90 
40 46 53 49 

83 94 96 93 

73 60 63 61 

62 ' 74 61 76 
•75 79 84 78 
IS 18 .^6 15 



Nation 



72 



ERIC 



6i 



0 



NorthiBit 



72 



TABLE 5. ,3 

Jest Item Performance of Massachusetts 17-Year-Olds by Reporting Group 

\ ■ ■ • 



^1 



6* 
16 



i: 



..J 



teicHiitlon of ItMi 



(Ajective 1 J 

I operiU Mclltite tools, repair 
rntal pirts^ 4tG. Mta^ 17 

1 desliin iMif1(i1ngt and or|onlz« 
cwttrucMoj)* W»t aM 17 |P 

1 rtcelve ai^d pay out money and 
MWA. i^rds. Htiat ai 17 

litfik persortliisually earns Itio 
•Ml; MNiey? S ■ ' 

lllilchWSQii' usually earns tlte 
policy? 

Wiin|.«( these Jobs requires 
lwJp1|ftliig and Mding? 

lilSAvocatlonal area doc$ 
#iUiO|| belong? 

In wiiltti vocatloaal .«rea does 
an Aif» NCCIIANIC belbiig? 

in Mliich vocational area dues 
a STME cURK belong? 

In Nlilcl) Vocational area docs 
a PHYSICAL THERAPIST belong? 

lo wiilcli vocational area does 
a TV REPAIRPERSON belong? 

ill Mliicii vocational area docs ' 
ft» INSURANCE AGEKT belong? 













Hassachusetts 












•NAEP \ 














Region 






)Ctfn( df CoMMiunlty 






HA 

1974-75 


All 


sex 














H 


*• 

r 


1 


2. 


3 

A 


A 


5 


6 


1 


c 


1 
J 




mil iiniflii 


26 


37 


16 


20 


33 


35 


* 

25 


29 


26 


26 


36 


22 


29 


19 


21 




DO 


,75 


05 


70 


86 




77 


81 


79 


75 


(9 


86 


79 


■68 


72 


V 


68 


66 


70 


65 


70 


72 

1- 


67 


73 


69 


67 


66 


68 


69 


79 




'« 

1 ■ 


61 


86 


76 


79 


85 


83 


82 


83 


78 


75 


87 


82 


80 


67 


, 75 




58 


49 


07 


53 


60 


\ 56 


64 


3n 


'f 

63 


50 


57 


60 


62 


70 


72 




A 7 


87 


67 


r 


Q1 


89 


88 


88 


QD 


84 


85 


09 


87 


90 






49 


49 


49 


53 


47 


51 


43 


57. 




50 


47 


52 


45 






46 


75 


71 


79 


73 


77 


78 


75 


75 


76 ' 


73 


70 


76 


77 






87 


94 


92 


96 


92 


-9^ 


90 


96 


96 


94 ' 


89 


95 


95 










8; 


a; 


ft? 


88 


87 


81' 


85 


90 


86 


84 


"86" 


88 


87 




■» > 


72 


78 


75 


80 ' 


77 


79 


77 


77 


.80 


78 


74 


73 


79 


AO 




V 


83 


81 


80 


81 


76. 


85 


88 


81 


86 


79 


It' 


76? 

1 


04 


,83^ 









Open-ended Itci. 



6iS 



i 




TABLE 5.3 (continued) 



M 

III 
2i 
23 
24 

i 

II 

13 
27 



OOJECTIVE I (coAtliMMd) 

III Hlilch yocitionil irea does 
I PRIIITEII iMlontr ' 

In Ntilcli vocittoniUrM doei 
KNm ASSISTANT belong? 

In tibleb vocittonil does 
i KAL ESTATE BROKER luloiig?; 

l(i Niilch vocationi) irei doos 
IIWTIIITKMIST belong? 

In Nkkh vocitiona) arei does 
I FURNITURE HAXER be)on||7 

NNIdi; Job re<)uires the least 
luptrvislon of otiier workers? 

Nhlcli job re<)uires eost, 
siiperviston of bther workers? 

Milcb Job wQuld allow the mst 
Independence? 

Milch occu|iatlon woi^d have the 
Mgiiest salary? ^ ; 

(MMECTIVE.2 

Ifltlch one of the fo11owi(ig Jobs 
requires good color vision? 

for wlilch Job Is -good eyesight 
liportant? ^ 

For wlilch Job 1s.it liii|>ortant 
to mji fast with your flogers? 

Miat kind of training Is needed 
to be a UAITRESS/UAITER? 

Vbat kIM of training is needed 
to be a filASS OLOWER? ^ 



Percentage of Students Answering Correctly 
llassachusetts 





























All 


Sex 




V 


Region 






Kind of Comunlty 


H 


F 


1 


2 


3 


4 


6 


6 


1 


2 


3 


4 


?3 


73 


72 


73 


• 

72 


73 


72 


71 


75 


70 


74 


72 


75 


84 

1 

86 


63 


86 


84 


65 


82 


86 


88 


81 


83 


m 


P86 


63 


,06 


86 


84 


89 


91 


85 


89 


85 


82 


84 


68 


87 


95 


94 


97 


95 


95 


95 


97 


94 


95 


92 


96 


97 


96 


93 


91 


94 


92 


93 


95' 




95 


94 


89 


92 




92 


51 


50 


51 


47 


51 


56 


49 


49 


56 


44 


49 


53 


51 


'33 


41 


26 


36 


36 


31 


32 


32 


28 




35 


37 


29 


20 


18 


22 


25 


17 


15 


21 


17 


16 


28 


26 


16 


16 


^35 


36 


34 


36 


40 


•45 


2? 


32 


35 


29 


31 


42 


30 


92 


91 


93 


90 


92" 


94 • 


93 


95 


91 


86 


90 


94 


93 


94 


95 


94 


94 

J 


94 


94 


94 


94 


95 


89 


92 


96 


95 


96 


94 


9? 




95 


96 


, 96 . 


97 


98 


94 


94 




96 


91 


90 


93" 


90 




90' 


90 


93 


94 


81 


93 


94 


91, 


6? 


60 


64 


60 

1 


63 


63 

8f-'.:.. 


59 

I, 


75 


62 


53 


55 


60 


•62 

« 1 



HAEP. 




93 
9S 

96 



NA 
I974*7S 



1 ■ , 

$2 

95 , 

96 



54 

6e' 

78 



78 
46 

30 
26 
46 



93 



61 ' 



TABLE 5.3 (contlrped) 



ItM 

■I 



31 



32 



33 



37 



38 



42 



44 



On^HpUon or ttw 



iiiit liiiiior tritnlM iVnowltd 
7bt^WITM. ATUIKWNTr 

iut MmI of tratAfM It mmM 
to bt I SOCIM. MUKeIt 

Nhit MiMl pf triiAfnfl'ti iMflded 
to bt I KFRlGEMTIOK HaMNICr 

fliiit Mi^ or tMfllnff is needed 
to^b^l 

tint kind flif training is needed 
tobtVni/MINMlsn 

Uiit ktiid of trilntno is needed 
to bf M AUrOHOOILE SALESMAN? 

Hhet kind or trilntng is needed 
to bt an CNGINEERt 

Milch Job requires the longest 
ptriod of training? 

Milch Job requires the longest 
ptriod of training? 

.Nhich Job requires th* longest 
ptriod of Iralning? 

k RMlilO /UWbUNCEIt has which of 
these etglit characteristics? 

A POLICE OFFICEH has Nhich of 
these eli^t characteristics? 

A SCCRETAIIV lias which j»f these 
Ifghe^ritteHittcsr, ; 

A BUTCIIEK has which of these 
eight characteristics? 

A BUS URIVEH has which of these 



<»>>t characteristics? 



Percentage of Studanti Aniwtrlng Correctly 



Massachusetts 



All 



23 
70 
81 
71 
87 

69 

75 
79 
62 
89 
63 
37 
78 
58 



Sex 



M F 



22 24 

V 

63 78 

82 79 

67 74 

88^ 87 

S4 60 

62 57 

73 78 

76 82 

,71 

88 89 

56 69 

40 34 

75 81 

66 61 



Heglon 



1 2 3 4 6 



26 '22 21 '25 21 49 

74 71 64 70 63 69 

78 86 76 83 74 80 

71 72 69 '4l 80 7q. 

r 

86 90 91 87 86 90 

48 65 52 64 52 51 



58 63 66 56 62 67 
76 78 72 74 72 76 



82 81 69 76 1\ 81' 
60' 63 64 63 59\64 
86 92 92 88 88 / 09 



67 '66 68 



66 62 



35 41 46 36 40 33 



72 81 83 1 80 84 7B 



52 63 62 69 63 66 



Kind of CoMMinity 



12 3 4 



,21 31 22 .21 
66 66 76 66 




38 36 37 36 
70 70 82 81 
44 '56 63 59 



HAEP 



Nation 



Northeait 



64 

81 
• 69 

0 



70 



83 



63 



it' 



1» t 



TABLE S.3 (contlnutd) > 





• 


-rr - 1— lit ■ «i» 




ONcrlptliNi of ItM 






All 

— 


Sex 






H 


F 




OBJCCTIVC^Z (cootimiKi) 










A TV ftCP/HMIAN Im tAlch of 
Umi ilflht chlracttrUtlcf? 


43 


4? 


44 




A tCCCniiriST hu nIiIcJi or 
MiHi light chiricttrfitlct? 


48 


47 


50 




lODAFISPCRSON'hAi lAilch of 
thist ityht chiricttrlttlct? 


37 


34 


39 


M 


Tbi proirM diicHbAd Mill 
prepare Jolin to ba: 


38 


36 


39 


ss 


To prepare for being a police 
officer, Sue should: 


11 


76 


86 




Nhit lovel of Rath does being 
a SmCS CURK require? 


91 


89 


94 


8S 


Hhat level of Mth does being 
III tUiiRiCIAIi require? 




47 


27 




iVfBI Iff pflill UUWJ uvini| 

m ENGINEER require? 


90 


89 


90 




Milt le^el of Mth docs belnn 
a BANK TEUEN require? ' 


69 


66 


72 


aft!. 


IMiil of Mlh (InAt he i 11(1 

a METEOKOLOGIST require? 


78 


70 


79 




OBJECTIVE 3 










List five tilings to consider 


63 


63 


64 




List five ways to learn more , 
ilMMt i Job before taking 11.** 


65 


60 


70 


9d 


Does Diane have enougli skill to 
continue with cabinet making? 


58 


58 


50 


SI 


Should Warren becoie i nercliant 
seaMn? 


86 


82 


90 



I'ercentage of Students /\nsMor|ng*CbrrQCtly 



Hiissachusetts 



Region 



I 2 .3 4 5 6 



40 47 56 41 47 41 

43 *53 52 40 54 48 

31 40 41 38 41 36 

38 40 39 30 33 35 



jo^ 



75 86 87 84 81 84 



90 90 96 90 93 ^94 
40 40 31 35 37 31 



89 91 93 88 92 90 

67 74 71 68 71 68 

77 79 75 00 76 79 

64 63 67 64 52 68 

60 66 ,72 67 G4 70 

54 61 70 57 62 57 

84 88 85 88 85 87 



Kind of CoiMunity 



12 3 4 



35 '40 46 47 

36 40 55 49 
28 32 42 3S 

34 37 39 37 

73 78 85 83 

81 91 % 90 

31 43 39 3^ 

78 69 95 88 

62 66 75 67 

76^6 78 80 



47 57 72 63 
50 55 73 '67 

48 50 64 57 
75 8& 91. 86 



NAEP 



Natlod 



85 
56 



Northeast 

— 



87 
59 



Haltery Criteria: Itew 14 - 5 of 5 correct; lte« 126 ■ 3 of 5 eorrect, 



TABLE 5.^ (continued) 




ttM 
f 



OHcr()»tton or itM 




1^' 



6T 



n 
n 
11 



I tuition, whit ihould 

III t)i(s i< tuition, MhAt thould 
Ml M 

Ir tilMiigwitbiquallflod 
(ifnon, you could liarn ibout 
fm ixptctod lilary. T or F? 

limklRg.H)thi()uiltflid 
pi^Qii, you could liirti about 
uurul tchoot counis. T or F7 

ly UlMng Mitit I quififioil 
pirton, ifou couldjiarn about 
nacMsary tkilli. T or F7 

ly Ulkiflt Mttir I qualified 
ptrson, you Mould Itncw your 
futurt co*worlteri, T or F7 

By tAlliintwl til I qualified 
iwrson, you could learn about 
advan^eient cliances. T or F?, 

Hhldt is an Equal Opportunity 
CiplOyer not expected to do? 

All of (he following are fringe 
benefits except: 



MhicI) one of the follOMing 
a Socle) Security benefit? 



is 



Riu*s 

include Mcd 




s iight 
as: 



1 



Llnde*« iiiirf^ iight 
include weh Ms* as: 

Fred's cernr plans night 
Include siich Join as: 



Percentage of Student! /InsNoring Correctly 



HaisaclHisetts 



All 




4S 
42 

06 

gi 

91. 
69 
01 

n 
n 

87' 
S5 

It 

38 



41 49 

43 il 

M B7 

88 ' 94 

67 94 

65 73 

79 84 




57 54 
70 74 
37 .39 



Region 



12 3 4 5 



44 M 43 4S 50 48 
39 43 45 42 44 45 



85 84 83 



86 66 



ERIC 
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XOMPAKING WCSSACHUSETTS WITH THE NATiM ^ 
• - AND. THE NORTHEAST REGION 



Introductidn ' ' \ . ' 

. • ■* . . •• ,., >. • . • ■ .. •■ . ■- . 

■^^^^^^ ■ j» . . * 

* • : '■ ' ' . ' .«■'"'''■' 

This Chapter compares the perfom^ of Mas$achusetts 13- and 17- 
yearrold students to the performance of students in the Nation and the 
Northea'st Region of the United States on selected items in Career iand 
Occupational Developmeht. Results for students nationwide and in the - 
Nortlj^ast were collected by NAEP and include ^data only for students who 
were currently enrolled in school. 

Comparative results are available only for those .iteirfs on |ihe test 
that were developed by NAEP and were administered to the same^age levels 
in both the N?\EP and Massachusetts assessments^ There were 28 I^AEP items 

on the Massachusetts test, of , which NAEP administered 19 to both age ; 

• ■ ' ' ■ ' ^ ' ■■■ , - ■ ■/^/'^' \ ^ 

levels, six only to IS-^ear-olds, and three only to 17-year-olds. Results 

. ■ ■ . . " ■ V ■ ■ ' ^ ' J: ' ■ ' ■ ■ ■ 

on- all individual items for which appropriate NAEP data are. available for 

comparison purposes are presented in Appendix F, Included-in that appen- ^ 
' '■ ^, ■ *. " • *• 

dix are thfe appropriate achievement scores (P-values) and'their associated 

^ standard errors^dr stiidents in -Massachusetts, the .Nation, and the North- 
east (afong.'With 'Uieir respective Massachusetts and NAEP item numbers): 
"Sjiatistically, significant differences between Massachusetts and NAEP 
performances are also designated for individual items. 
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Iritferpiretation of Results 




C^rtafn differences existed bet^^ the Massachusetts and NA^f P . 

assessments that bear on the interpretation of results. First, no paced 

■ ■• '■ ■ " ■■■■.':■..**•■...,:■ ^'^^ : ■ . ■ . ^ ■ ' ■ ■ :■ ^- .. ^r:';-- 

^ audiotapes were used for test administration in Massathusetts; IjAEP usesy^^^^^ ^^^^^^ '^^^^^^ 

'/ . : ^ ^ i^l^ed a^^^ test'dinections; and for every test 

• - NAEP tests' 13-year- olds in October through^Bfetember andilZ-yeap-olds --in ' •• 

Mafch and April * while Massachusetts tested bolbh ages J n February and / : : * ' ■ 



March. There is no conclusive ev-ntence as to the impact of these dif.fer- 
ertces on achievement. ' ' , - 

; ■ , ■ ■ . ■ ; . ■ . - ■■ ■ * ■ • ■ ■ " . . . . • 

Sunwnary of Results 

■ ■ - : - ■■■■ ■ ' : ■ 

Figures 6.1 and 6.2 show the averagfe percentage of NAEP test items 
, answered correctly for each objective by students In Massachusetts, t))e 
Nation', and the Northeast at the two respecti ve age 1 evel § . The NorJ^st 
Region is defined by NAEP as including Maine, New Hampshire, Vennont^ 
Massachusetts," Connecticut, Rhode Island, New York, New Jersey, Washington 
D.C., Pennsylvania, and Maryland. . 

Compari sons ^with the Nation . Overall , 'Massachusetts 13-year-olds' 
dutscored their counterparts nationwide by between four and eight percent- 
age points on two of the five objectiyes, and scored, at about the same 
level on the remaining three objectives. On. the other»hand, Mas^chusetts 
17-year-olds scored, lower ...than 17-year-olds throughout the Nation by 6% to 
9% on two of the objectives, and scored at about the same level on the 
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. ■ . . ■ ' ■ ^ 

^ ' ? . ' 'ffeURE 6J V ^ 

.'Comparl'ng Massa&iuseifetS^ the Natipn ,*ar?a the Northeast 
■'by QBj€tcti ve-^13-^Year-01^s. , ' -« . 
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remaining 'three objectives.! Beciause only a small nuinber of items are' 
ipatch^d to each objective (only one item for Objective 5 was administered 
to both Massachusetts and NAEP 17ryfear-.olds, for example), the, reader is 
cautioned not to make undue generalizations. - 

. ■ ■ ■•■ \ ■ ' ■ •■' " • -'i'.- ■■• ■ . 

Canpari sons With the Northeast . Because the Northeast t4*adi tional ly 
outscories the Nat iorii. th| scores for students in the Northeast 'ire a better 
standard against which tb judge ihe performance of Massachusetts- student?... 

Massacbusettis 13-year-olds outscored their counterparts in the North- 
east:% 4% on one objective, scored lower thi^^ the Northeast 

bY 4% to 8^ on two objectives, and scored at :about the same level on the 

^ • . ■ .. v- . , * ■ 

remaining two objectives'. Sevehteen-year-olds in Massachusetts were out- 
scored by' those in the' Nortfieast by about 8% on two objectives, and scored 
<at about the <s'ame|level on the remai n>n^^ree objectives. The reader is 
> again reminded py the small number of items matched to each objective. 



Overview . In* general, the' relative perfomiance of Massachusetts 13- 
year^olds was stronger than that of 17-year-olds. In addition, the, 
achievement at both.^ge levels was better in ^lotiiparisdn to the Nation than 
to the Northeast. 



■ C H A P T E R 7 
YEAR-TO-YEAR COMPARISON^ 



l^ntrodtuctlon 



^ This chapter compares the performance of 17-year^d stiidehts* thii , 
year to the perfonnance of those 17-year-plds who were administered, testsv 
in .Occupational Attitudes or Occupeftional Knowledge during the 1974-75 
assessment. A totiail of 61 items in this year's assessment wei*e Identical 
to Items on the tests for the previous assessment, and cornparisoriS; are 
available 'pr|ly for these items. v \'' ■■ ^. 

Data Analysis 

' ' \r . ■ '■ ; ; 

Table 7.1 presents the average percentage of Items 'answered cor^^ 

by Massachusetts 17-year-olds in the two assessment years. Four of th6 

five objectives were matched to iteirts on which yeaiP^to-year cpmparl^ 

ca[n be made. Results aVe also presented for all commfiini ties, regardless 

of the matching objective. Tests of significance were. not performed on 

these results due to the unavailability of standard errors for the 1974-75 

data. . ■ . • " 

Summary of Results . ^ ■■ ■■ y 

' ■ ' " ' : ■ * .V. ■■■■ ■ • . ■ 

. Studervts tested- this year outper'^orjped those testec(*1n 1974-75 by 



one to four percentages^! nts /on items matched to the firjrt three 



-7 ■ . ■ . . • ^ TABLET/l ■ * 

; 'Year-to-Vear Comparisons by Objective of n:ems Administered 
' to Massftchpsetts 17-Year-0.1d8 in Both 1977-78 and 1974-75 



Ob;jective 



.1. JOB CHARACTERISTICS 
(15 items) 



2. JOB REQUIREMENTS 
(24 items) 



3. CAREER" DECISION MAKING 
ilj items) 



4. BASIC SKILLS 
(nB common' items) 



5. ATTITUDES AND VALUES 
(5 items) 



ALL 61 COMMON ITEMS 



Percentage of Items V| 
Answered Correctly 

Tf — r 




1977^78-^ . H 



69.0 
63. 9- 
59.1 



'85.0 



65.5 



4 



974-75 



64.8 



62.6 ' 



55.. 8 



87.4 



63. '3 



obiectives (Job Characteristics, Job Requi reraents , and Career Declsfon 
.Haking)^ On the other hand, students in 1974-75 outscored students tested 
tWs year by about 2%, on the*X^rage, across'"the five items matched ti^' 
"Objective 5, Attitudes and' Values, c ^ 

Perfprmance on indiyidual i terns varied accordi rig to item, 'such that 
studej?its/;this year^p or the same as students In the 

previous assessment. Results on individual test itfems njay be found in .. 
table 5.3. On average, howeveri students scored abotrt two percentage 
points higher t>i is" year than did those in 1974-75. While^this difference 
may be ststi^tically significant; it is probably not large efnough to b6 
educationally, Ineaningful, and overall performance should be consiidered 
"about ^)*^ s'anjje" in, the two year^. • 

Because tes;jting took place earlier in the school year during the 
1974iiiS^as sessmerit (from October through December rather than during Feb- 
ruary and March ),^the sample composition for -^e two assessments was quite 
different. * ' '-^ ' 

At the 17-year-old level, many more of the students vyere in the 
-twelfth gr*ade during the earlier assessment (83% of the sample in 1974-75 

)■ : ■ 

compared to only 26% in 1977-78). In other words, in the 1974-75 assess- 

* a . . . ■ - 

ment tite typical 17-year-old- student was a twelfth-grader tested early in 
tV schdol ypar,, while in 1977-78 the typical 17-year-old was an eleventh- 
grader tp^ied in the middle of the school year. The fact that studept-s 

V ■ ' >^ \ . *■ ^ ■ • • . 

this/yeair- performed about the S'ame as those tested, i^n 1974-75 i^ thG^refore 




/^5t m a mof^ favorable, i f^t. 
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: C H A PTE R 8 . 
ACHI EVEMENT RESULTS FOR REPORTING GROUPS - • ^ 



Introduction . . *. 

4rThe purpose of this chapter is to relate achievement on the test 'to 
various school and stwdent characteristics. To this end, ichool informa- 
tion was solicited from the principals of each parti cipa^g school and 
matched to "^the scores of students tessted withfn ithe 's<; 
Students were admtnistared a questionna-ire whicK requested information on 
their demographic characteristics, their experiences *M.#:,Mr^^^^ guidance, 
the nalpre of their schoolwork, their perceptions of school, tjieir future 
plans, and the nature of student-parent interactions.' The student and 
sdhool variables, as well as region and kind of community, represented tffe 
pool* of potential reporting variabrles. . J \ 

The selection of reporting variables from the pool was accomplished 
on the basis of two criteria: (1) a significant statistical relationship 
to achievement and (2) meaningful ness and importance to Massachusetts 
decision makers. A total of 21 variables were selected to define report! ijig 
groups. Each selected variable is defined by several reporting categbries, 
ahd each^ category represents aQr^Jl^^ V- ' • 

This chapter examines the test performance of MassacHusetts students 
in each- of the reporting groups and compares the p(erforma.nc^f each group 
to that of the population as a whole. . ■ • 



Data Analysis 

. ■ ' ^ , • * , ■ ■ ■» 

• Achievement, In terms of mean total test sdtores, of each of :the report- 
ing, gjr&ps. Is compared to the achievement of all -students at the appropriate 
age level. Mean total test score represents the avi'erage percentage of ;tt«ns, 
answered correctly on the entire test (Let, across alV five objectives).. : 

«th1s Is the most statistically reliable measure for use In thgw ' comparl sons , 
since it Is! derived from the largest number of Items (I.e., all iVsms on the 

.: test).- - 

The achievement scores of the reporting groups of particular interest 
are^iscussed in the narrative below. Appendix G contain^ complete analyses 
of all reporting groups, not only on the basis of total tMt score, but '-mf 
' also on eact» of 'the five objective scores. The percentage of individuals 
;%ln each reporting' group is provided in Chapter 9 (for students) and 
Chapter 10 (for principals). " 

The differences • between groups (itescribed in th*s chapter are those that 
were significant .at the .05 level df confidence. The reader is referred to 
the section on J' Irtterpreti^ve Issues" in Chapter 4 for cautionary statements .\ 



regarding JnfefjerfGes drawn from these/results T Wfille differences between 

^groups may be statietiaally signifufmt'f t)iey may be tc^.^ihall t0l>e»^edu.ca.7i 

■ ' . ..' J . _"■ . * « ' ■ " ■ 

tionally meaningful What is educationally meaningful' depends on th)kj»«ead- 

: : . V' %. I / ■ ■' 

er's judgment, about the practical implications of given differences in scores. 




Resu1ts:by Redion arid Kind of Conmunity 

Average achievemflirfC Fig'ure^^^ ^.2 display average p^vforfnanae ' 

by regipn and kiw of community, respectively. At botrf age levels, Big-City 
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TIGURE 8;1 

^ » .... 

, Achievemelit on Total Test by Region 
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■ FIGURE 8.2- * 
Achievement on Total Test; by Kind. of Coranunlty 
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INDUSTRIAL ' RESIDEVTtAL 
^■?6 SUBURBS SUBUf\8S 



BIG CITIES 

^rapiewnli mtlitinlty significant diff«r*ne« batwMn Kind of Community and Statawidt A»ara«a. 



OTHER 



iERiC 



d2 



studerits tJerforme.d to 11 below the statewide average, while stgdents 
'In Residential Suburbs exceeded' ttij! statewide avefeige by 3%. irfi'scores- 
of studetit's in I/idustrial SflrbUrbs and Other places did not differ signi- 

■■ ■ ■■ ■. ■ •.■ '.■ 

ficantly from statewide scores. ,. •; 

■ ■■ - ! , • '.■ ' . ' ■■ ■ . ■ , ■ ' " ■• 

At both age ||Bvels,' differences between respective regions and the 

state average were! generally vei^y small. ; The -only except^ftft'^aSftiund 'in- 

.' , ■ ^ . "- /Jr'' * '■ . 

•Region 3/ the Plttsfield f^egion, where both 13- and Ir7-year-olcl9 putper- 

fonned students statewide by a small but statistically s^ignificant margin. 

vthejjreader is reminded that each' of the- regions pdmpr^ises a fairly large 

area, as 'Shown on the map on page 7. For example,. Region 1 consist's of 



•> 




\ 1- 



many corliimni ties, outside of Greater Boston. 



' i. ' . ' 



Distribut i on of responses . Tables 8.3 and 8>4 display the distribu- 
tion df pevcfent .across the state and,' in each region 2(tid kind of . ' 

conwnurtity.. Exami nation of Table 8^3 shows., that across the^-staie and'.in 
each region, over half of the IS-year-olds answered correctly'.betweeri 61% 
and 80% of ;al] items" Qn the'test. Most of the othef^ stlil^nts answered " 



correctly betVieen 4W'and 60% of the,, Items. ^Similetr results were found 



:;|jacross the ^ four* kinds of conmiuni'tiesi except in B^g Cities, whe.re raore"'^: 
Students' .Scores J^ll in the pilddlev r?inge. Very few students in any cat6- 



gory ^nswered^ correctly more than 8^% or less t^an' 40% of the items. / 
Between 62% and 76% of 17-#£ar-olds answered correctly 61-80? of the 



tiest .items, while 12% to 28% of them; answered corri?ctfy 81-100% cif. the- 
items. JfThere' were no jiiajor differences accordttig tp. regional, or- caratiunty- 
group. V> - ' " . - ' ' ' Y > 
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> Dlstrlbutiort of TotaVTest Scor6.;by Reporting Grpliji 
for Massachusetts 13-YearrOlis / ^ 




ALL STUDSffTSy 
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1.. Boston 
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Sf Springfield ; 
6, Central MasSi, , , 

WMD 6f 'CdHtJNrfy : ^ 
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'100% 
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39 
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33 
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24 
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■ - TABLE 8.4 • 

•'Distribution of Total T^st Store by Reporting Grdlip 
, for Massachusetts 17-YearTQUs ' ; - 



'-i^: -^'Wporti^ Groups ^ 



.ALL SiWEJlTS . 

' - V . . 
■ REGION:. ^ • 

^ 1. Boston y . ' ^ 
\l. Norliheast 
'3. P|ttsfield.. 
,4, Southeast 

5. ' -Springfield ^. ■ ^ ■ 

6. Central Mass. 

KIND OF COMMUNITV: 

I. 6ig Cities 

I. IndbstriarSuburbs 

'i. (G^iderftial Suburbs 

;4. 'Other Connunities 



Percentage off^tudents with 'Achievement Scores i^p^e 
: " ; • : Follwlpg-^ianges:^^^ / " 
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: \ m^.: 

Profile of Big Clfeiis versus Residential Subur^^^^ In light of the 
findings of substantial achievement differences between students In Big 
Cities and Residential Suburbs; a^special profile of the characteristics 
Of students and schtoU in Big Cities was developed. The rfeader Is 



. directed to Chapter 10, page 113 f6r a review of this profile which 1S based 
^^ Inclpal questionnaire 'responses. * 



on studeTit and principal questionnaire 'responses, 



Jesuits for Additional Reporting Variables . ^ 

# : , The average performance of eacih of the additional policy-relevffnt 
• reporting groups defined by questionnaire responses are presented in 

Table 8.5. • . 

■.. ■■ ■ ' • ■ . 
Sex of student * At both age levels, females performed slightly above 

the statewide average, while males performed slightly below, with differ- 



ences mX exceedinig 2%. 




^itude toward school ; There was a general trend at each age level 

. ■ . ■ . - ^. ^ ■ ' '■. ' ■ 

for performance to improve as the student's reported attitude toward school 
became more. positive. Those who "strongly dislike" school performed 5% . ^- 
' below the state avpirage* 

Discussions about career plans 

■ ^ • .... '[\ .:, . ^. ^ ^ ,:■ ' ■ 

•V # Discussions'with guidance coJnSelor : At .the- 17-year-<5Td level only, 

. A those students who have discussed, career plans with a guidance 

coufiselor outperformed those who have not. Further, among 
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TABLE 8,5 . V ' 

Achievement by Student and Principal 
Questionnaire Reporting JBrpups 



Reporting Group.; >■ 

'. ' * • . 


Average Percentage of Items on 

Total Test AnswerecJ- Correctly . 

- . . ■ ■■ -.^ 


13-Year-Olds ; 


' n-Year.^O'lds 


ALL STUDENTS . 






SEX: * 

Male ■ 
Female 


• 61* 
. 63* 


iB 
m ■ 

71* 

73* : . 


HOW bo YOU FEEL ABOUT SCHOOL? 






Strongly disl ike 
Dislike " ' 

OK y 

Li^e ^ ■ # 
Strongly like ^ 


57* 

• #61* 
" 64* 
6> 


/o* 

70* 
75* 
.74 


HAVE YOU DIsdlJ^^AREER PLANS 

WITH A GUIDANCE COUNSELOR? • 

Yes. ; ■ , ■ 
No 


61 
' 62* 


.74* 
70*- 


HOW MAN^ TIMES THIS YtAR HAVE YOU 
DISCUSSED CAREER PLANS WITH A 
COUNSELOR?*** 

None , J / 

Once or twice. 

TnlPee or more times / 

Don't know or there^is no counselor ^. 


7 ■ ^ , " 


^9* 

m3* 

^5* 

'65* ^ 



* Represents significant differeoce in score between students who selected 
this response and statewide average: 
_ ** Question not asked of p-year-olds. ..i ^, 



•■ TABLE 8.5 (continued) 



Reporting Group 



Average Percentage of Items on 
fttal Test' Answered Correctly 



13-Year-Olds 17-Year-Olds 



HAVE YOU DISCUSSED CAREER PLANS 
WITH A PARCKT? 

Yes 
No 



HAVE YOU DISCUSSED CAREER PLANS 
WfTH A FRIEND? 

Yes 
No 



HAVE "YOU DISCUSSED CAREER PLANS 
WITH A PERSON IN AN INTSKeSTING JOB? 

Yes 
No 



HAVE YOU DISCUSSED CAREER. PLANS 
WITH A TEACHER? 

No . 



HOW MUCH ARE .YOUR BARENTS INVOLVED 
IN YOUR SCHOOLWORK? 

Hardly at all- 
Only a little 
Quite a bit 
A lot 



00 YOU WANT A PROFESSIONAL OR 
MANAGERIAL TYPE "OF JOB? " 

Yeis ' • 

No : ^ r ' ' ) * ifl^ 

Tldonn know 




' 62* 
60* 



62 
62 



61* 
63* 



. 61 

62 



59* 
62' 
163* 
61 



63* 
60* 
62 



73» 
69* 



73* 
69* 



7? 

72 



74* 
71* 



71* 
72 
72 
'73 



73* 
70* 
72 



* Represents, significant differente in score between students who selected 
this response and statewide jfverage. 



RepoKing Group 



'Average Percentage of Items on 
Total Test Answered Correctly 



13-Y.ear-Ortls 17-Year-Olds 



DO YOU WANT A JOB *AS A SKILLED LABORER 
OR AS A SALESPERSON? 

Yes 
No 

1 don ' t know 



DO YOU WANT A JOB WHICH 
SEMI- OR UNSKILLED LABO 

Yes 
No 

I don't know 



J^QUI^ 



HOW MUCH DO YOUR MiRENTS WANT YOU TO 

GO TO SCHOOL OR COLLEGE AFTER HIGH SCHOOL? 

Hardly at all , 
Only a little ■ . 

Qui te a bi t ' m ^ 

A lot f 



WHAT ARE YOUR PUNS AFTER HIGH SCHOOL? 

Full-time job or armed services 
Full-tira6 job and night school 
.Specialized training (e.g. , nursing,. 

'technical, or business school) 
2-year or community college 
4-year college 
Haven't decided • 



HAVE YOU EVER PARTICIPATED IN A WORK- STUDY: 
FLEXIBLE CAMPUS, SHARED EXPERIENCE, OR 
STUDENT INTERNSHIP PROGRAM?** 



Yes 
No 



r59* ^ 

63*. r 

"63 . 



56* 
63* 
60* 



55* 
59* 
62 
64* 



58** 
52*1 

61 

61 

66* 

59* 



68* 

74** 

73 



65* 
73* 
69* 



^* 
67* 
72 

' 75* 



66* 
68* 

69* 

72 
77* 



69* 
73* V 



* Represents significant difference in score between studehts who selected 
. this response and statewide average.v 

** Question not asked of 13-year-olds. ^ 
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^ TAfiLt 8.5 (continuecl) 





' , ^ . . i ■ i-^ ■ -. 

fl|porting Group ■ 

' > ■ — ^ — • — ^ — — 


^ ^_ 

Avet^age Percentage of. Items on 
Total Test Answered Correctly 

13-Year-014^: . 17-y6ar-01ds 


WHICH. TYPE Of PROGRAM OR CURRICULUM 






ARE YOU NOW EKROLLED?** 




• • 


General • ✓ 
Vocational 




69* 




65* 


Col lege- bound ^ 
Buslnesis or comlfnercial 




'77* 




68* 


Oon't know 




64* 


Ip YUUK oLHUUL f\vi toLA 1 1 1 LLxt; AunUUL 






Yes ' ' • ^ 


60* 


71 

/ J. 


No 


' 63* 


- 73 


HOW WOULD YOU RATE PARENTAL SUPPORT OF 


- 




YOUR SCHOOL'S POLICIES AND PROCtDURES?t - 






Excellent 


63 


74 


Good 


63* 


- 72 


Average 


59* 


71 


Fair 


59 


71 


Poor 


50* 


♦ 67*. 


HOW WOULD YOU RATE THE ATTITUDES OF YOUR 






STUDENTS TOWARD SCHOOL AND LEARNING7+ 






.Excellent ^ 


63 


74 


Good 


63* 


74* 


Average ^ v 


58* 


70 


Mr 


. 62 


^ 65* 


Poor ^ 




65* 



f * Represents s'ignificaht difference in score between students .who selected 
. ^ this response and statewide average. . , , 

** Question Hot asked, of 13-year-dlds. 
t Principal questionnaire item. ' ' * . 




4 

t 



17*year-Alds viho have th^j^ tQ counselors withiri tbe^st^FiSf, 
perfonnanae incceased with frequenpy of j^ch consMltations. 

• Discussions with parents ; Students who reported dlscussing^tieir - 
. career plains with a parent tended to perform- higher .than those^Mo. 

have not done soi^Jhe difference in scores was larger among 17- 
Xear-old* ^4%) than -amon^l^-year-olds <2*). ^ , ^ ' . 

• Dig*cuss/ons with friends : Among 17-year-olds only, those who have 
talked wUh friends atout^career plans ou^^gy-ijafpmed tho^||^Ko^ haVe 
not. ^ ' 

• 4 

V 

• Discussions 'with a person in a .iot^ of interest : ■ At the 13-year-old 
level onlyr ttiose who reported that th^ have talked: with a person 
in a of interest to them slighty outperformed those who havie . 

not. -. ' ' . ' ^ ' ' " 

. • _ ^ ' ■■ -", ' • .■ ■■ ■ 

• Discussions with teachers : Achievem^frtrscores y0fe not related to 

whether or^not 13- year-old students reported discussing their career 
plans wij|F a teacher. Seventeen-year- olds who indicated that they 
have spoken to a teacher about their future career pTdns scored 
slightly higher than the statewide average, while those. v^hb repbrte 
/hat they have not had such discussions scored si ighMy below the 
State average. . , . * ' v; 

Parental involvement . In both age groups; studervts, who reported thit 
thelr'parents were involved in 'their schoolwork "hardly 'at alT;" scored 



• / 1 



a. 



•/T 



slightly; below the statewide ave*»^ger' The diffirtnces, however, were 331; ' 
at the 13-year-old level and only , ly at the l7^?iT»-old level .• 



^ture plans 




• career ftspira'tl ons ; At bothjifrtie . 1 evel s . the relationship between ' 

reer -aspirations and achievement was the same. Students who . 

, '- ' ■. ^ ' 

Thdicated that they would like ,t|p have a job thti't could be described 



^f^ssional" or >*na^eri-al''\^Koni^d slightly above the 
^^atewide ajey a^^ h^ those wtib '^ditated that^th^y would like 



havife *\ti)iddl^|^el (''sales'^ or " sKi 1,1 ed labor") or low-level 



("semi-skilled" oS"unski lied") job scored hilpw the statewide 
average. 

•^ Parental ..-encouragement, to continue schooling : At both age leVeTs, , • ' 
th^e was a strong tendency for performance to. improve wljth the||, ' 
increased emphasis -placed by parents on postsecoridary education. 
Students whose parents wanted them to continue schooling after high '^^ 
school "only a little" or "hardly at all scored Below' the statewide 

/. average by 3-7%, while students whose parents encourage them *!a lot'' 

v.. scored 'higher *than the state by 2-3%. : 

■ • . '■ ■ ' ■' ' . ■ . ' ' - ' ■ ■ y . • , 

• POst^hi'qh-school plans : At both age levels', siudents^who reported 
tha^ they plan ^o attend a foar-year colleg^ swr^d. V5%:hig^^^ 
the statewide^average, while those who ' pi an^n a fulT-tiitifr job or,.- . 
on combining school with a full-titne job scored 4-10% lower than 
Students .Statewide. 



V 
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Current pr^ g rain enrol llnent ' ♦ • ^ 
\ Participation In work- study, and other, programs' . Se venteen-year^ol ds 
were asHed 1f they had ever participated In' a. work-study, flexible^ 
campus., shared exp^rifinci;- or* student Internship who 
-;VesppVd^d "yes" scored J^6Tow the* statewide aVisr^^^ 3%./ - 

yresenj tjh i'Qh school prograrfu ' A-t"thi^ VeVel studertis . 

; who indicated that they wfe re a^\led ^n a col lege- bound program^ ' r 

scored 5% higher that^he stjatewide average, while Students who s^id 
. they were enrolled in a/^^Jral, vocational, or business program 

scored 3-7% ^wer than the /statewide average*. ^ 

Principal •quesliorlnaire vlfriabl^s 

m SchoQj_j ^icipation in ESEA Title I protjrarii : At the 13-year-old . ' . 
level only, students -inpcliools which receive ESEA Title I funds 
-perfprmed. slightly bVlow the statewide average, while those in non- 
Title r schools scored si ifhtly above the state average. At the 
17-year-old level, there %as no significant difference between the 
score Qf/either of these groups and the statewide average". 

w Parental support of the school ; A#both -age levels, ^students .whose 
principals reported that parental support of the school is "average, 
"fair," or "poor,^' performed less well than those whose pVincipals 

■. reppfied parental support as "good" or "excellent." 

« Student at titude toward school : At the 17-yeaY-6jd Hsvel. students 

- ^ — ■ — ' . * ; f 

whote principals rated Itudent attitude as generally "fair" or "poor 



scored 7X below the state av6ragtf^ while those students whose ' 
principals rated attitude?, morg favorably tended to perform more 
- ".highly; Results were , not as" clear- cut at the 13-year-:old level. 

Results of Research Analysis of Vocational Students 

■ ".. • ^ \ . / ■ • • ; ■ ■ ■ •. 

The Division of Occupational Education of tije MDE requested a compari- 
son of the testf performance «»f t;hose 17-year-olds enrolled iip: voCatlortal 
programs Jt) regular and reglp^ial academic Jig h sch(J&s-w1th ^be ^f orinance 
of 17-year-olds "enrolled In vocatlortai progrtms"^ regltJftil vocational - 
tectmfcal schools. Additional test administrations were conducted to 
Insure that a sufficient nupiber of studefcs Trom each category were rep- 
resented. Including the "oversampled" sddents and the reigular statewide 
sample, there were a total of 175 vocational students in academic high 
school's and 398 vocational students In regiiajnal vocational-technical 
sctooti:^ , ' ' 

, The results are presented in Table 8.6 and are quite straightforward 
The average achievement performance on the total ttst was' the same for the 
two groups. Furthermore, the difference in achievement on each of the five 
ot^jectives was smaller than 1% in eiih case. 



. TABLE 8.6 

Comparisons of Test AGhiev«g|nt for Students Enrolled 
, - in Vocational Programs i,n Academic 
versus Vocational Schools 





^ — ^r— ^ r^^ 


Aver^age' Percent^e of Item? on Total Test 
Answered Correctly 

(I.- : 


• 


^OWe€tive ' 


VocalPional Students 
*■ . in Academic 

, 'Schools . 
: ; (N = 175) 


Vocatignal Students , 
in. Regional Voca-tional. 
Schools • 
(N. = 398) 


1. 


Job CharaC^teristics 




65.9 


f 

2. 


Job R<^quiremen1^^ 


61.2 


61.9 


3. 


■• 

Career Deei si on\ Making 


62.3 

* 


1 

61.4 


'4. 


Basic SKtTis., ^ 


> 79.5 


79.5 , • 


5. 

* * 


Attitudes and Values 


^> . 
' 74.2 


.73.9 

\ 


. TOTAL TEST 

, . ■ 


67.8 '■ 

' * 


r * 

'57.8 



C H A P T E R 9 t 
RESULTS OF THE STUDENT QUESTIONNAIRE 



Introduction i 

The purpose of this chapter Is to summarize the responses of 13- and 
17-year-old Massachusetts students to each Item on the student question- 
naires. The questionnaires for the two age groups appea/* lin Appendix B. 



They are Identical except for four questions which were asked 



ippendi 
0^ 17- 



year-olds but not of 13-year-olds. The purpose of administering .these 

i 

questionnaires was to Identify factors about studen-ts ^nd 'their home and 

\ \ ■ ■ ■ ' 

school lives that might be re<lated to *ch1evement. Results on the rela- 

tionships that were observed are 'presented in Cliapter 8i 

^ummiJ^ies of qyestionoai re, responses are' provided for all students 

within each grade and for students in each region and in each kind of 

■' ' / ' ' • 

communffy. The data reported are th^ percentages of students in each 

. ' ^ . f ■ . 

group selecting each (response to eactV questiqnnatre item. • 
v., ■ ^ A . 

The data summaries are presented for alV questionnaire 1 terns 'tn' Table 
•9.«l^r 13-year-olds, arid^in Table 9,2 fo^^7-year-olds. ^,the narr;?t1v)B 
that accompanies the 'tables highlights only the mps^t policy- relevant of 
these results. The" narrative )is organized by questionnaire itfisjn and 
presents- for ?ach one a suiranary of responses by all students at each age 
levef. '. • ' ' . . ' . • ./ , 

The* reiader Is directed to Chapter 10, page. 113 fbr'a pro'tilevdescrib- 
ing differences between students and schools in Big Cities ve'iHiis ' * ' 
Residential Subiwbs. - * *^ 



-rj- 



JABLE9.1 

Cpos$tabuUt1ons of Student Questionnaire Results (13-Year-Olds) 
by Region and Kind of CodWunUy, Reported In Percentages 



.Qui|tionn|i1r«;i|jR 



sex OF THE s'lUOCNT: 

k . 

MAOe 'OF THE STUDENT:, 
•th 

9th ■ 

10th , 

y ' . ■ 

HOW DO YOU FEEL A«)UT SCHOOL? 

I aoft't'like It 
Moitly, I don't like It 
School Is OK 
iMoltly» I llke It 
I like It d lot 



HOW OFTEN ARE YOU ASSIGNED URILL WORK? 



/iMst every day 
.Once or twice a week 
Once or twice ^iwnth 



,H(!M OFTEN ARE YOU ASSlGNElTfeADJjJi^ < , 
HOMEWORK? .... 



ATiost wery day 
Once ortwtoe a week 
Onc*s)r twUe a inonth 

i : ■ ; 

o 

ERIC ' 




1 



TABLE 9.1 (continued) 



' f 

Questionnaire Item 


Total 


. Region 


Kind of Conmunity. 


1 
1 


C 






\ 


C 
D 


1 


2 


J 


4 


HDU OFTEN ARF VflU ASSIGNFD WRITING 




















11 




HOHEWORK? 


• 






















Almost everyday 


4 


" • 4 


2 


3 


5 


6 


, 2 


5 


3 


2 


5 


Once or twice a week 


23 


29 


28 


14 


19 


20 


15 


21 


• 24 


26 


19 


Once or twice a month 


73 


67 


69 


82 


76 


75 


83 


73 


73 


71 


76 


HOW OFTEN ARE YOU ASSIGNED PROJECTS TO 








* 












\ 




00 ON VOUR OMN? 
























Almost every day 


5 


6 


' 7 


6 


4 


4 


4 


8, 


4 


5 






Once or twi^e a week ' . 


18 


16 


20 


15 


19 


19 


19 


20 


18 


19 


16 


Once or twice a month 


76 


77. 


/J 


70 


77 
It 


77 


.77 

HI 


. 71 


78 


76 
1 u 


80 


HAVE YOU DISCUSSED CAREER PLANS MITH 
















■ 




• 




A GUIDANCE COUNSELOR? 
























Yes . 


24 


21 


23 


29 


30 


26 


23 , 


35 


22 


21 


23 


NO 


75 

• 


77 

II 


77 
II 


7n 
/u 






7fi 
/o » 


63 


77 


7Q 


77 


HAVE YOU DISCUSSED CAREER PLANS MITH 
























A PARENT? 










■ 




/ . 










Yes 


86' 


85 


87 


85 


86 


89 


' 87 


85 


t 


87 


87 


No. • 


13 






15 


i*f 


11 


12 / 


13 




13 


13 


HAVE YOU DISCUSSED CAREER PLANS MITH 
























A FRIEND? 
























Yes 


78 


78 


81 


74 


75 


\ 

V8 


77 


77 


77 


78 


79 


^0 


22 


21 


19 


26 


24 


/21 


22 


21 


22 


22 , 


21 


.HAVE YOU DISCUSSED CAREER PLANS MITH 
























A PERSON IN AN INTERESTING JOB? 






f 












i 


V 




Yes 


34 


34 


32 


26 , 


36 


33 


36 


41 ; 


,32 


'32 


33 


No * 


65 


64 


68 


73 


63 


65 


63 


56 


6^ 


^ 67. 


67 



ERIC 
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TABLE 9.1 Watlnued) 



Questiomialre Itk 



Total 



Region 



2 '3 



5 6 



Kind of Community 

~21 



3 



HAVE YOU DISCUSSED CAREER PLANS WjTII 
A TEACHER? 

lies 

No • 



tIAVE YOU EVER TAKEN A TEST TO DETERMINE 
YOUR CAREER PLANS? 

Yes 
No 

I don't blow » 

DO YOU FEEL THAT FIELD TRIPS TEACH YOU 
USEFUL THINGS? 

Yes . , 
No 

Never gone - , 



HOU USEFUL HAS YOUR SCHOOLING BEEN IN 
liaPING YOU TO CHOOSE A CAREER? 

•A. 

Not very useful ? 

Somewhat useful 

Very useful 

I don't know «, 



HOU MUCH ARE YOUR PARENTS INVOLVED IN 
YOUR SCHOOLMORK? 

Hardly at all V 
Only a little 
Quite a bit 

A lot # 



15 
84 



24 
53 
23 



69 
10 
1 



16 


16 


17 


12 


13 


52 


53 


50 




56 


23 


20 


26 T 


J 


24 


9 


10 


7 


8 


7 



11 

28 
40 
21 



erJc 



10 
26 
41 
23 



28 



16 
12 



17, 
51 
22 
10 



14- 
46 
29 
11 



Z8 aZi 
42 \4i 
21 \ 



12 >: ■ ,1 

28 ^r,^ 
40 39 
0 18. 



15 


16 


13 


15 


' 12 


15 


W 


i 

14i 


13 


oJ 




00 




OD 


01 


70 




oil 


18 


25 


38 


'■27 


21 „ 


25 


22 


^!1 


26 


59 


5? 


42 


45 ■ 


56 . 


57 


55 


55 1 


50 


22 


23' 


2(j 


28 


22 


18 


,23 


24' 


^24 


88 


* 

90 


89 


. .*85 


87 


93' 


89 


88 


90 


..J 


10 


11 


12 


12 


7 


9 • 


11 . 






1 


0 


3 


. 2 


. 0 


2.; 


1 


1 1 












f. 


• '■" 

























20 
55 
16 
10 



98 



16 
83 



24 
56 
21 



86 
12 

2^ 



15- 

53 

23 , ^mn 

9. 8V. 



9 


15 


10 


to 


10 




24 


29 


'28 


24- 


29 


27 


37 


39 


38 


43 


41 


39 


29 


17 


23 


■1 " 


j 20 ■ 


20 



TABLE 9.1 (continued) 



Questionnaire Item 



■ FAMILY OCCUPATIlQfM STATUS: 



High 
Medlu* 

Low 

Unknown 
None 



you WANT A PROFESSIONAL OR 
MANAGERIAL TYPE OF JOB? ' 



Yes 
No- 

1 don't know 

DO YOU WANT A JOD AS A SKILLED 
LABORER OR SALESPERSON? 

Yes 
No 

I don't know 



DO YOU MANT A JOB UHICH REQUIRES 
SEMI- OR UNSKILLED LA0OR7 

Yes 

No , 
I don't know 



HOU SURE ARE YOU ABOUT THE KIND 
OF JOB YOU iKXJLD LIKE TO HAVE? 



Not very sure 
Somewhat sure 
Very sure 



I 



Total 



54 
21 
7 
9 

3 



52 
29 



11 
78 
11 



Regjon 



1. 2 3 4 



10 
80 
10 



10 
78 
■13 



Kjr^d of CowBun Uy 
2 3 ' 4 




30. 


yi 


,28 ; 


29 


52 


53 


52 




18 


lb 


•20 


24 



13 
74 
14 



/ 



46 

■34' 
.8 

8 

5 



52 
31 
17 



29 
55 
16 



13 
78 
10 



22 


25 


■ 19 


28 


46 


43 


48 ' 


46 


32 


32 


33 


27 



^0 
46 



46 
28 

9 
11 

6 



51 
31 
18 



56 
17. 



13 
79 
8 



r 



56 
26 
8 
9 
2 



61 

'26 
23 



36 0 
19.' 



13 



46 
26 
10 
12 

7 



53 
34 
13 




48 
29 

7 
12 

4 



26 
55 
18 



65 
23 



4A 

7 9 
1 4 



49 55 
32 . 24 
19 20 



49 

32 
20 



28 
51 

2.1 



20 


21 


24 


22 


50 


41 


43, 


49 


30 


37 


33 


29 



29 
53 
18 



16 


10 


" 7 


13 


74 


77 


82 


76 


10 


13 


11 


10 



I 

n 



ERIC 



99 



TABLE 9.1 (continued) 



(juestlonnaire itew 

— J. 


lotaj 


1 




Region 






Kind of Coninunity 


2 


'3 


4 


5 


6 


1 


2 


3 


4 


























1 

TO UIIAT EXTENT DO YOURf PARENTS WANT 




W 


















• 


lUU lU bU lU bUlUUL UK lUCttut AMtK 








1 
• 
















lllUH SulUULr JJ ^ f 












,1 


% ■ 










iMira ly ai di 1 y 


^ 7 


C 


c 

J 


9 


10 




i 1 


10 


5 


4 


8 


uniy t little 


ij 


19 
U 


III 


10 


15 


' n ' 
i J 


* 14 


14 


15 


9 


15 


lJUUG a DU 


J*l 


19 
jC 




40' 


35 


33 


•If 


29 


38 


33 


• 38 


A 101 ^ 




^\ 


aft 






47 

If 


•f 1 

r 


aA 

•ID 






39 


UtIAT ARE YOUR PLANS AFTER HIGH SCHOpL? 


\ 








7 




f 




Iff ' 






Ful i-tlie *job or enlist In annea 


n 


in 
10 


7 
1 


8 


9 


19 


Q 


13 


\9 


6 


10 


services 


















\ 


. 2 


3 


Full-time Job and school 


3 


3 


3 


3 


3 


3 


2 


• 6 




Special training (nursino, technical, 


11 


IJ 


U 


10 


16 


0 

0 


ia 
1*1 


15 




10. 


\ 14 


business schools* etc.) 
















3 










1 
J 


3 

•J 




6 


2 


3 


4 


4 


3 


3 


4^year college 


41 


42 


49 


34 


36 


43 


35 


28 


38 . 


52 


36 


1 haven't decided ^ 


31 


28 


28 


38 i 


34 


31 


36 


34. 

1 


-34 


26 ^ 


35 


ilAVE YOU EVER DONE WORK ON A REGULAR 
















' t 






* 


BASIS (PART-TIME, SUMNER, OR HOUSEHOLD 






















• 


CHORES)? . 
























Vcs 


89 


86 


91 


92 


91 


|91 


89 


85 


„ 89 


90 


91 . 


Ho * 


11 


14 


9 


7 


9 


|9 ; 


11 


14 


"11 


10 


9 


t- 

























ERIC 




TABLE 9.2 

Crosstabulatlons of Student Questionnaire Results (17- Year-Olds) 
• by Region and Kind of Conwunltyv Reported In Percentages ■ )^ . 



Ouestlohnftlre Itis 


Total 


Region 


Kind of Ccnnunity 




2 


3 


4. 


' 5 


6 


1 


2 


3 


4 


SEX OF THE STUDENT 
















« 








Nilf 








CA 


4£ 


CI 

53 


42 




OU 


^ i7 


A7 
4/ 


F«Mle 


SI 


W 


4o 


Ml 


bo 


4b 


CO 




4U 


,53 


CI 
bJ 


6RMIE OF THE STUDENT v 










< 


• 








)• 


1 


itil 


2 


4 


1 . 


0 


1 


2 


0 


7 


3 


0 


0 


m 


8 


11 


b 


6 


'8 


10 > 


5 


17 


13 


4 


6 


nth 


64 




79 
It 


H 


119 


04 


91 

#1 


S3 


Al 




09 


12th • 


27 






99 


90 


9R 


9i 

c4 




91 


CO 


90 ' 


HUM 00 VOU FEEL ABOUT SCHOOL? 
























I don't m \t 


\ 


6 


5 


5 


5 


4 


9 


5 


s 


6 V 


7 


Itostly, 1 don* t like U 


10 


10 


10 


7 


12 


10 


10 


9 


14 


10 




School It OK 


34 








lA 


AA 


11 


33 




33 




Hostijf.I 11k« It 


44 


ii 


All 






19 


40 


4S 


lA 


A^ 


Alk 
40 


Mike tt i lot 


6 


6 


€ 


5 


8 


4 


5 

.ii' 


8 


6 




7 

1 '■ 


HON OFTEN ARE YOU ASSIGNED DRILL VORK? 






















\ 


Alwst every diiy 


49 


4a 


47 


S3 


47 ' 


47 


54 


37 


33 


58 


48 


Once or twice a. week 


25 


22 


29 


22 


29 


24 


20 


29 


25 


21 . 


28 


Once or. twice a Mflth 


26 


30 


t3 


25 


24 


28 


25 


33 


41 


20 


24 


HOW OFTEN ARE YOU ASSIGNED READING 
HOHEWRK?, j. . * 




, I 




















Almost every day 


43 


38 


45 


48 


36 


55 


46^ 


30 


36 


49 


45 


Once or twice a week 


37 


40 


34 


37 


• 40 


28 


40 


37 


41 


37 


35 


Once or twice a norlth . 

—a J . 


20. 


21 


21 


15 


24 


16 


13 


32 


24 


14 


19 



; TABLE 9.2 (continued) 



■ 'J 

Chiestlonniirt Itei 

« 


— f — 
Total 


1 

' Region 


Kind of Coflinunity 


1 


2 » 


3 


4 


5 


6 


1 


2 


3 


4 


NOM OFTEN ARE YOU ASSIGNED WRITING 
























MNEWMK? 
























Alioit every day 


r 


• 5 


6 


5 


4 


6 


5 


5 


4 


6 


5 / 


Once or tifice a Meek 


34 


35 


36 


35 


32 


41 


28 


25 


30 


41 


29 


Once or tMice a nonth 


60 


• 


58 


60 


64 


52 


67 


68 


66 


53 


65 


HOy OtTEN ARE YOU ASSIGNED PROJECTS TO 
















a 








DOON V0UR0HN7 . . 
























Aliost evtry day 


8 


8 


* 

1 


9 


5 


12 


9 


9 


9 




10 


Onc0 or twice a Mee,k 


18 


17 

If 


14 

17 


10 


20 


24 


IS 


20 

IpV 


20 




19 


Onct or tMlct a mnth 


74 


74 


74 


75 


76" 


62 


76 


71 


71 


77 


72 


HAVE you DISCUSSED CAREER PLANS WITH 
























A GUIDANCE COUNSELOR? 
























Yes 


61 


59 


55 


66" 


64 


59 


66 


• 50 


51 


64 


67 


No 


38 


38 


44 


33 


36 


40 

t 


34 


45 


47 


> 36 


33 


HOU MANY TINES IN THE PAST YEAR HAVE YOU 
























DISCUSSED CAREER PLANS WITH A COUNSELOR? 
























None 


31 


33 


35 


26 


31 


32 


23 


38 


45 


27 


25 


Once or twice 


.40 


36 


42 u 


50 


36 


43 


43 


X 36 


34 


43 


40 


Ihree times or wore 


. .27 


28 


23 


23 


29 


21 


31 


19 


19 


28 


33 


I don't rewewber or there Is no ^ 


- 2 ; 


2 


1 


1 


4 


3 


2 


6 


2 


1 


2 


guidance Counselor 


* 






















>^ 

HAVE YOU DISCUSSED CAREER PLANS WITH A 
























PARENT? 
























Yes * 


89 ' 


87 


90 


88 


92 


90 


91 


86 


84 


92 


90 


No 


10 


11 


9 


12 


8 


10 

-i 


9 


11 


15 


8 


9 



• ERIC 
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a * " TABLE 9.2 (continued) 



Questionnaire Item 


Total 


t 






Region 








Kind of Conmunlty 


1 


"2 


3 


4 


5 


6 


1 


2 


3 


4 








1 




• 




t 










A FRIEND? 




















• 




Yes 


85 


83 


82 


85 


86 


91 


87 


82 


81 


87 


86 


No ' 


U 
* 


14 


17 


13 




9 


li 


14 


17 


n 


n 
1 J 


HAVE YOU DISCUSSED CAREER'plANS WITH 
























A PERSON IN AN INfERESTING JOB? 
























Yes 


47 


SI 


43 


. 49 


50 


40 


48 


46 


50 


46 


50 


No 


50 


45 


55 


51 


49 ' 


58 


51 


47 


48 


S3 


50 


























1 

HAVE YOU DISCUSSED CAREER PLANS MITH 
















■ 






























A TEACHER? 
























Yes 


37 


38 


36 


39" 


41 


28 


37 


'36 


37 


37 


38 


No 

I 0 


61 


58 


63 


^\ 


58 


71 


63 


58 


61' 


62 


61 


HAVE YOU EVER TAKEN A TEST TO DETERMINE 






/ 

/ 








i 






• 




YOUR CAREER PLANS? ; 










* 














Yes 


* 5L 


45 


51 1 


57 


5'9. 


45 


53 


35 


44 


56 


56 / 


No 


37 


42 


39 


30 


29 


42 


37 


49 


40 


35 


32 ^ 


I don't know 

S 


\i 


12 


Jl 


13 


12 


14 


11 


46 


15 


9 


12 ^ 


00 YOU FEEL THAT FIELD TRIPS TEACH YOU 


















•>> 






USEFUL THINGS? 
















« 






* 


Yes 


85 


85 


88 


84 


'87 r 


82 




81 


•79 


89 


88 


No 


10 


10 


10 


11 


8 


12 


■ 10 


11 


15 


'8 


.8 ' 


Never gone on one 

_j , — 1 


4 


5 


2 


4 


6 


6 


4 


8 


7 


3 

.1 .. 


4 



103 ( 

ERIC 



TABLE 9.2 (continued) 



Questionnaire Item 



Total 



Region 



12 3 4 



Kind of Comnunlty 



2 



3 



HOM USEFUL HAS YOUR SCHOOLING BEEN IN 
HELPING YOU TO CHOOSE A CAREER?, 

Not very useful 
Soiewhat usefill 
Very useful 
I dofl't know 



HOU HUGH ARE YOUR PARENTS INVOLVED IN 
YOUR SCH0OLUORK7 



12 
48 
32 

8 • 



/ Hardly at all 
Only a little/ 
Quite t bit 

■ A lot ' 



FAMILY OCCUPATIONAL STATUS 

High 
Medium 

LOM ^ 

Unknown 
None 



00 YDU WANT A PROFESSIONAL OR NANAGERI 
TYPE Of JOB? 

Yes 
No 

1 don't know 



DO YOU UANT A JOfrAS A SKILLED LABORER 
OR SALESPERSON? 



Yes, 
No ' 

I don't know , 



ERIC 



18 
33 
33 
IS 



54 

29t 
7 
7 
4 



55 
28 
16 



32 
52 
16 



14 
46 

30 
10 



15 
33 
34 
18 



10 
48 
34 
7 



17 
.30 
40 
14 



8 
52 
30 

ro 



12 
48 
32 
9 



13 
51 
31 
5 



15 
49 
31 
6 



18 
30 
39 



20 


24 


21 . 


21 


16 


17 


20 


32 


35 


39 


33 


•32 


32 


36 


32 


23 


29 


32 


36 


35 


31 


16 


18 


12 


14 


16 


17 


13 



52, 


57 


53 


50 


54 


^)56 


42 


45 


62 


27 


27 


32 


32 


31 


'29 


26 


32 


27 


7 


6 


7 


8 


7 . 


6 


12 


9 


4 


8 


7 


3 


5 


6 ^ 


6 


12 


8 


5^ 


6 


3 . 


4 


5 


3 ' 


2 


7 , 




2 




















] 


















56 


' 58 


56 


53 


58 


53 


58 


44 ' 


59 


30 


24 


28 


32 


26 


29 


26 


42 • 


24. 


15 


18 




15 


16 


18 


17 


14 


}^ 




jr 
















33 


30 


34 


30 . 


36 


31 


'39 


46 


24 


50 


53 


48 


54 


51 


55 


48 


43 


57 


16 


17 


18 ' 


16 


13 


13 


13 


12 


19 



104 



10 
45 
36 
9 



11 
48 
32 
8 



13 
49 
29 
8 



14 
47 
33 
6 



55 
31 
14 



35 
51 

13. 



TABLE 9.2 (continued) 




'00 YOU UANT A JOB MHICH REQUIRES SCMI- 
OR UNSKILLED LABOR? 

V«s 

Tdon't knoN 



HON SURE ARE YOU ABOUT THE KIND OF 
JOB YOU MOULD LIKE TO HAVE7 

Not very sure 
SoMMhit sure 
Very sure 



TO UHAT EXTENT DO YOUR PARENTS MANT YOU 
TO GO TO SCHOOL OR COLLEGE AFTER HIGH 
• SCHOOL? 



Hardly at a)) 
Only a little 
Qujte a bit 

iot 



MHAT ARE YOUR PLANS AFTER HIGH SCHOOL? 

Full-time job or enUst In armed 

services * 
Full-tliae job and school 
Special training (nurslna, technical, 

business schools, etc.] 
2-year coWege 
4-year toltpge 
Haven' 'decided 



7, 
84 
9 



22 
43 
35 



8 
15 
34 
42 



14 

5 
11 



^85 
9 



21 
43 

36 



1 

14 
33 
46 



13 

'5 
13 



9 I 9 
41 42 
18 16 



5 

b; 

8 



23 
44 
34 



8 

31 
49 



11 

5 
9 

6 
51 
17 



10 

78 . 
12 



10 
81 
9 



8 
81 
11 



7 

85 
8 



77 


21 


22 


20 


l!2 


36 


41 


46 


47 


.<^41 


41 


38 


32 


32 


38 






















9 


'lO ' 


9 


8 


10 


24 


14 


17 


17 


16 


36. 


35 


40 


38 


34 


30 


40 


55 


37 • 


38 






\ 










\ 






19 


18 


15 


15 


19 


3 


5 ■ 




5 


9 


17 


9 


' 13 


12 


14 


11 


9 


11 


12 


8 


24 


37 


37 


38( 


27 


25 


21 


15 


17^ 


22 



10 
78 
12 



9 

82 
9 



15 
23 
33 
28 



21 

5 
17 

9 

25 
23 



4 

88, 
•8 



3 
9 
33 
54 



3 

8 
57 
14 



10 
81 
9 



21 


• 


17 




43/ 


44 




3/ 


39 



12 
19 
37 
32 



18 
7 

U 

13 

30 
19 



105 
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TABLE 9.2 (continued) 



Qutitlonniirt ItM 



HAVE YOU EVER DONE MORK ON A REGULAR 
BASIS (PART-TINE, SUHCR.OR HOUSEHOLD 
CHORES)? 

VW 
No 



HAVE YOU -EVER DONE VOLUNTEER WORK IN A 
FIELD YOU ARC INTERESTED IN7 

No 



HAVE YOU EVER PARTICIPATED IN A WORK 
STUDY. FLEXIBLE CANPUS. SHARED 
EXPERIENCE. OR STUDENT INTERNSHIP 
PROGRAM? 

V«s 

No' 



WICH BEST DESCRIBES THE PROGRAM IN 
WHICH YOU ARE NOW ENROLLED? 

General 
Voutlonal 
Co] lege- bound 
Business or comerclal 
I don't knoN 



ToUl 



94 

6 



30 
70 



81 



13 
12 
53 
13 
8 



92 95 
8 5 



31 
68 



23 
75 



11 
13 
53 
13 
9 



27 
62 



15 
84 



10 
11 
61 

12- 
6 



Region 



97 
3 



30 
69 



14 

85 



17 
14 

12 
9 



34 
66 



17 
83 



14 

20 
49 
10 
6 



94 96 
6 4 



22 
78 



16 
83 



16 
16 
49 

12 
7 



95 
5 



32 
68 



15 
84 



17 
2 

51 
19 
10 



Kind of CciMunlty 



2 



91 
9 



31 , 23 
68^ 76 



28 

71 



10 
23 
-38 
18 
10 



IS 
83 



10 
29 
35 
15 
10 



3 



92 96 
8 4 



31 
69 



15 
85 



12 
3 

69 
10 
6 



96 
4 



30 
69 



18 
81 



20 
13 
46 
14 

7 



106 
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Summary of Results 
% 

Attitude toward school * About 50t of l7-ye«r-olds and 42* of 13-year- 
olds reported "liki)jg" or "strongly liking" school, whlj^e 16-lM of both 
age groups indicated that they "dislike" or "strongly dislike" school, and 
34-40% reported feeling that "school is OK." 

■ 1- 

Discjissions about career plans 



• Di scussions with guidance counselor : The percentage of students who 
reported talking to a guidance counselor Increased from 24* among 
the 13-year-olds to 61* for the 17-year-olds. Further, 11% of the 
17-year-olds reported discussing their career plans with a guidance 
counselor at Veast three times in the previous year. 

• DiscussioWs with parents ; At both age levels, about nine out of 10 
stiMents reported that they have discussed their career plans with 
<5ne or both of their tarents. 

• Discussions with friends ; About eight of every 10 students in both 
age grouips Indicated that they have talRed about their career plans 

X? 

^ with friends. ' ^ . 



• Discussions with a person in a job of interest : More 17-yearyOlds 



>cussi 
\x/\Z- 



tharr 13-year-olds (47% versus 34%) indicated that they have dis- 
|cussed their career plans with'a person in a Job of interest to them. 



-96- 



• D1 scullion with ttachtn ; Mort thtn twlct as inai\y 17«year-o1ds as 
13-yaar-o1di (37X v«riui 15X) htvt talkfd with a ttachar about 
carttr plans. 

Carat r aotl twlt Uiti . A 111^610 proportion <ff students atreach age 
leval Indicated that th^y have nfWr taken a test designed to help them 
decide on the{r career plans (5W of 13- and 37» of 17-year-ol|ds). Fur- 
themiore, •about 12S of 13-year-o1di and 23X of 17-year-olds did not know 
whether or not thity have ever taken such a test ^ 

• • / 

Usefulness of field trios . Ainost nine of every 10 students replied 
thk. school -sponsored field trips Uught theai* useful thinfas. 

Usefulness of schooling . Host students reported feellrJ^ that their ^ 
schooling has been ^soiMwhat" or "very" useful In helping thein to fulfill 
their careeV- objectives. Only \2% of the 13-year-olds and let of the 17- 
vj year-olds replied that school has been "not very useful" In this respect. 

y Parental InvoKeaient. More 17-year-olds (18X) than 13-year-olds (UX 
ryorted that their parents We "hardl> Jt all" Involved In their school- 
work, while 48% of the older students and Sit of the younger ones reported 

^qulte a bit" or "a lot" of pansntal Involvement. 

Future plans ^ 

• Career aspirations ; A little won than half of the students at ^ 
^ each age^^Sl Indicated that they aspired to a hIgh-leveH "pro- 

fessional" or "nanagerlal") Job. Alnost a third wanted a mlddle- 
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t 



■X 
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'leve.^^^siales'' or "skillea labor") job^r an* about 10% aspired'tOi 
low-level ("semi-'*'- 6r "unsKilled") jo6s.' ' • 



Certain ty> about career a spt rations : At both age levels 78% of the 

~I ^ — ^ ' > 

•student^ reported that th^ weire 'e4ther "very sure" or "somewhat ^ - 

sure" abc>ut\he» kind of job they would like to have' in the future. 

• Parental encouraqefDenVi:o continue schooling ; About one-fi^fth of 
the students in'each age group reported that their parents wanted 
them. to continue their education after high school "only a little" 
or "hardly at all ," compared to four-fifths who sa-^d tbal^ their 
parents encourage them to do so "quite a bit" or "a lot." 

• Post-high-school plans : At both age levels, 41% of the students . 
plan on attending a four-year college, while 12-19% plan on obtain- 
ing a full-time job or combining jobs and school. Further, 31% of 
13-year-olds and 18% of 17-year-olds have not yet decided on post- 
high-schooll plans. 

• • ^ • . 

Volunteer work . Among 17-year-olds, 30% indicated that they have, 
at some time, done volunteer work ,in "a career area of possible interest to 

them. - , , 

^ ■ ' :■ • K '■' 

Current program enrollment ^ 



Parti c^i pat ion in work-study and other programs ; Only 18% of 17- 
year-olds reported that they had at some time participated in a 



ERIC 



work- study, flexible campus, shared experience, -or student iiitern- , 



ship program. 



/ 



Present high school program ; , Just>ovef half of the students (53%) 
reported that they^were in college-Sound programs, and approximately 
13% of the student? indicated that they were enrolled in each of 
the other types of programs (general, vocational, or business). 
About B% of the students responded that they "did not know" the 
type of program in which they were currently enrolled. 
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, CHAPTER 10 • 



^lESULTS OF THE PRINCIPAL QUESTIONNAIRE 



V 

/■ ■ 



Introduction . " 

' . . ■ ■ f ■ 

/ Th,e questionnatre^admlnistered to principals of all participating 
schools collected information on schooVvariables that might bear a 
relationship to achieyement (see Chapter 8). However, the responses of 
the principals, to the questionnaire items are interesting in and of ^ 
themselves as a general characteriza^^n of the schools in which testing 
occurred. 



?3 



The questionnaires for principals of i3- and 17-year-old students 

■ , ■ * 
were similar but not identical. Copies ■t)f the principal questionnaires 

appear in Appendix C. The data are given as the percentage 'of principals 

of students at each age level selecting each response to-each questionnaire 

Item. The results for all principal questionnaire Hems are presented in 

■ ■ " * 

Tables 10.1 and 10.2 for principals of 13- and 17-year-aJds, respectively. 
The tables display results for ppncipals,|in the total s^pi^e and in each 
region and kind of community. % . / ' ^ v 

The narrative that accompanies 'w^^^t^ highlights the most policy- 
relevant of these findings. .The nar*rative, organized by 'questionnaire 
item, presents a summary of the responses by principals of students at each 
age level. Since principals normally characterize students by grade level 
rather than age level, principals of 13-year-olds were asked to respond to 
the questionnaire in relation to their eighth-'grade students, while 



r 



TABLE aO.l 



Cross tabulations of Principal Questionnaire Results (13-pr-blds) 
by Region and Kind of Cdmnunity, Reported in Percentages 



Questionnaire* Item 


Total 


r ' 




Region • 






Kind of Connunltjt 


1 


2 


3 


4 


5 


6 


1 


2 


3 


4 


ORDSB THE FOLLOVIHG fJVE OBJECTIVES IK 
















■ ( 








TERMS OP THE EMPHASIS PLACUD ON- 
























IKSTSUCTIOK OH GUIDAHCE IS SOUR SCHOOL. 




* 




















• KNOWLEDGE OF JOB CHARACTERISTICS: 




/ 




















First 


12 


9 


0 






22 


21 




a 

Q 




Q 
0 




01 




11 
di 


n 




33 1 


Q 




CO 


^1 

Li- 


17 
it 


Third 


19 


27 


13 


n 




11 


14' 


u 


Cj 


ID 




Fourth 


12 


9 


19 


n 




11 


14 


c 

D 


17 


9 


17 


Fifth 


35 


' 36 J 
/ 


38 ' 


5J1^ 


29* 


22 


36 


59 


25 


36 


21 


• KNOWLEDGE OF JOB REQUIREMENTS: 






I 


















First 


20 


• 9 ■ 


31 


13 


29 


22 


14 


18 , 


25 


18 


21 


Second 


22 


27 


13 


13 


12 


33 


36 


12 


25 


18 


33 


Third 


21 


23 


^9 ' 


13 


35 


33 


0 


12 ■ 


25 


27 


17 


Fourth 


33 


36 


38 


63 


18 


11 


36 


53 


25 


33 


21 


Fifth ' ■ 


2 


5 


a 


0 


6 


0 


.0 

• 


'6 


0 


0 


4 


























• CAREER, DECISION MAKING: 








si 




* 












First { , 


9 


9 


13 


0 


12 


11 


■■ ' 7 


0 


17 


6 


17 


Second 


16 


19 


13 


13 


29 


11 


7 


12 


17 


18 


17 


Third 


38 


36 ' , 


44 


38 


18 


,22 


71 


53 


33 . 


42 


25 


Fourth 


17 


27 


6^ ^ 


13 


24 ■ 


33 ' 


0 


18 


25 


■ .'9* 


25 


Fifth 


17 




25 


38 


: 18 




7 


18 


8 


■P 


13 
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TABLE 10.1 (continued) 



t 



Questionnaire Item 



i 



8ASIC SKILlS 

First/ • 

mti 
Ffiurth' 
Mfth 



ATTITUDES AND VALUES 

First i 

Second 

Third 

FourtI) 

Fifth 



BOW SATISFISD ABB 70U WITB THE LEVEL 
OF mVLEOGS OB SKILL OF STUDEBTS IB 
BELATIOB TO TBESE OBJECTIVES? 



KNOWLEDGE OF JOB CHARACTERISTICS: 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



Total 



Region 



1 2 3 4 5 6 



Kind of Coomunlty 



2 



3 '4" 



28 
17 
12 

4 



27 


361. 


25 


60 


30 


18/ 


44 


25 


16 


18 


13 


25 


16 


18 


6 


0 


9 


9 


13 


0 



2 
37 
52 

5 



KNOWLEDGE OF JOB REQUIREMENTS: 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



32 


31 


25 


18 


33 


^29 


35 


33 


24 


25 


23 


13 


38 


18 


11 


7 


35 


8 


15 


13 


14 


13 


13 


12 • 


Jl 


7 


18 


• 0 


12 


13 


0 


25 


, 13 


24 


11 


14 


12 


17 


21 , 


4 


32 


19 


,13 


29 


33 ' 


36 


0 


42 


27 


42 



0 
41 
46 

9 



0 
31 
69 

0 



0 
50 
38 
13 



29 
18 
18 
24 
12 



12 
24 
59 
6 



0 


.14 


29 


17 


33 


21 


56 


36 


24 


33 


27 ' 


38- 


U 


14 


29 


17 


15 


8 


22 


21 


6 


8 


21 


21 


11 


7 


12 


25 


3 


8 















0 
44 
56 

0 



0 

43 
43 
0 



5 


5 


6 


' 0 


12 


0 


.0 


41 


36 


44 


25 


47 


44 


43 


47 


46 


. 50 


63 


•41 


44 


43 


5 


9 


0 


13 


0 


11 


0 



0 
35 
65 

0 



0 

33 
58 

8 



0 
"49 
36 

9 



8 
25 
63 

0 



8 • 


3 


8 


17 


49 


■ 42 


58 


36 


46 


17 


6 


0 
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TABLE 10.1 (continued)/.. 



QuestlofiMlrie Itet 



Total 



Region 




Kind of ComnunUy 



2 



3 



• CAREER DECISIONMAKING 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



BASIC SKILLS 

Very satisfied 
Satisfied 
Otssatlsfied 
Very dissatisfied 



AniTUOE AND VALUES 

Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



INDICATE THE MAJOR tJAYS IN WHICH 
THE CAREER AND OCCUPATIONAL DEVELOPMENT 
PROGRAM AT YOUR SCHOOL COULD BE IMPROVED. 



More' guidance counseling personnel. 
More inservice training for guidance 
personnel 

"More inservice training' fo^ teachers 
More career education classes 
More infusion of career concepts into 
' other courses 
Better tnaterials 

More innovative learning experiences 
Hf- o 

•- ERJC . .; , : |. . „ 



2 

57 
. 4 



1 

61 
31 
2 



•7 
63 
24 
2 



22 
11 

38 
29 
59 

9 

21 
5 

' 6 



0 • 


0' 


b 


: <0 


11 


7 


6 


0 


0 


4 


46 


25 . 


13 


' 36 


22- ■ 


43 


24 


25 


46 


29 


41 




63 


65 


67 


^0 


65 


75 


42 . 


63 


5 


25, 


0. 


0 ■ 




6 


0 


6 


0 



5 

59 
27 



14 

50 
32 
0 



4 



9 

v9 

55 

73 

5 
18 
5 
5 



0 
50 
38 

0 



r 0. 

75 
13 
13 



6 0 



63 
25 
0 



63 
38 
0 



25 
25 

44 
19 
44 

19 
13 
6 
6 



13 
13 

25 
50 
50 



'6 
77 
18 
0 



36 
0 

29 
47 
65 



11 
44 
33 
11 



44 
11 

30 
22 
56 




0 

79 
7 
7 



0 
71 
24 

6 



14 

7 

50 

,22 
57 

i^i 

21 
7 
7 



24 
0 

47 
35 
65 

6 
18 
0 
6" 




42 
25 

25^ 

8 
17 
17 

8 



42 
21 
64 

9 

24 
3 

6 



0 


0 


0. 


0 


0 






59 


67' 


64 


59 


58 - 


6l/ 


63 


41 


33 


29 


41 


33. 


24/ 


■ 33 


0 


0 


0 


0 


0 


6' 


0 



8 
63 
25 

0 



25 
4 

25 
38 
67 

13 
21 
' 4 
4 



TABLE 10.1 ^continued) 



Questionnaire Item * 



SHOULD ALL STUDENTS MEET A HINIHUM 
ACHIEVEMENT LEVEL IN READING, WRITING. 
AND MATHEMATICS AS ONE REQUIREMENT 
s F|fl HIGH SCHOOL GRADUATION? 

No 

Not sure 



WHICH OF THE FOLLOWING SHOULD SET 
THESE STANDARDS? 

Local education agencies 
State board of education 
Legislature 

Both local agencies and state board, 

of education ' 
Other ^ . 

. None of above . sv- 



IS yOUR SCHOOL AN ESEhlTLE 1 SCHOOL? 



es 
-No 



HOH 00 YOU RATE PMNTAL SUPPORT QF YOUR 
SCHOOLS POLICIES PROCEDURES? 



Excellent 
Good 
Average 
Fair . 
Poor 



Total 



79 
14 
7 
« 



33 
8 
1 

54 

2 
2 



45 
52 



35 
41 
19 
4 
1 



91 

5 
5 



41 
5 
0 

50 

5 
0 



36 
59 



32 
41 
23 
0 
5 



69 
13 



50 
0 
0 

44 

0 
6 



38 
56 



56 
25 
6 
6 
0 



Region 



1 ' 2 '3 
<f 



88 88 
13 12 

0 f 0 



V 



0 
13 

0 
75 

13 
0 



50 
50 



13 
63 
25 
0 
0 



18 
24 
0 
59 

0 

-0- 



47 
53 



47 
24 
24 
6 

' 0 



5^ 6 



67 
22 

ir 



44 

0 
0 

44 

0 
11 



44 
56 



33 
33 
<^22 
11 
0 



64 
21 
14 



29 
7 
7 

57 

0 
0 



64 

36 



14 
71 
14 

0 
0 



Kind of Community 



2 3 
i- > ■- 



77 
12 

12s 



18 
12 
0 

65 



65 
35 



35 
24 
24 
12 

,6 



83 
17 
0 



79 
9 
12 



42 

8 

0 
50 

I' 



J 



42 39 
58 58 



25 
25 
42 
0 



46 
49 

3 



0 , 0 



79 
21 
0 



46 21 

3 13 

3 0 

46 58 



42 
54 



25 
50 
25 
0 
0 
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TABLE 10.1 (continued) 



Questionnaire Itei 



ToUl 



Region 



1 2 3 



5 6 



Kind of Comnlty 



2 



3 



IKN 00 YOU RATE STUDENT AHITUOE 
TOMMIO SCHOOL iMO LEARNING? 

Excellent 

Good 

Avenge 

Ppor 



FIRST QtMRTER PERCENTAGE OF ATTENDANCE 

73-94 
95-98 



27 
2 

' 0 



SECOND QUARTER PERCENTAGE OF AHENDANCE 

70-91 
92-97 



SO 
4S 



40 

5S 



I 



41 

S5 



19 
63 
19 



31 
56 



13 
50 
38 
0 
0 



SO 38 38 
56 SO 



38 
50 



4 



35 

35' 

29 

0 

0 




65 
35 



' 6) 
22 



41 

59 



44 
44 



43 

.57 



43 

57 



12* 
35 
47 
6 
0 



77 
12 



0 
50 
33 
8 
0 



33 
61 
6 
0 
0 



25 
38 
36 
0 
0 



67 21 ' 54 
2S , 73 46 



42 ; 24 33 
SO 70 67 



C 



11 



u 



i 



TABLE 10.2 



^ Crosstabiilations of Principal Questionnaire Results {17-Year-Olds) 
j by Region and Kind of Cownunity, Reported in Percentages 



Questionnaire Itein 



ORDER m Foimm five objectives is 

TERMS OF THE EMPHASIS PIACED OH 
IHSTRUCTIOH OR GUIDAHCE IH WUR SCHOOL, 



• KNOWLEDGE Of JOB CHARACTERISTICS: 

First , V . 

Second 

Third 

Fourth 

Fifth r 

■ I. ■ 

• KNOWLEDGE OF JOB REQUIREMENTS: 

First 

Second 

Third 

Fourth 

Fifth 

t CAREER DECISION MAKING: 

First 

Second 

Third 

Fourth 

Fifth 



Total 

4 



26 
19 
19 
31 
5 



Region 



1 2 



A 5 



Kind of Coomunity 



2 



3 



13 
16 
33 
25 
13 




8 
8 
35 
46 
4 



14 
10 
38 
24 
14 



0 
22 
44 
11 
22 



16 
26 
37 
' 16 
5 



16 


12 


24 


22 


5 


13 


18 


35 


14 


22 


5 


13 


15 


8 


19 


22 


16 


0 


14 


12 


10 


22 


16 


25 


37 


35 


33 


11 


58 


50 



13 I 



If 

13 
30 



13 
38 
25 
13 • 
13 



22 
13 
22 
17 
26 



15 
20 
5 

15 
45 



39' 
15 
23 
8 

15. 



.15 
2S 
13 
15 
33 



15 
P5- 
35 
20 
15 



15 
0 
31 
64 

0 



8 
18 
38 
25 
13 



>9 
9 
21 
15 
46 



n 


21 


38 




30 




23 


33 


18 


33 • 


16 


-«5— ' 




15 


f 


31 


15 


21 


11 


26 


25 




10 




23 


18' 


24 


33 


32 


13 


26 


40 




15 


30 


33 


11 


5 


0 


4 


5 




8 


5 


3 



18 
21 
27 
15 
18 



117 ' 



TABkE'lO.2 {continued) 




BASIC SKILLS 

First 

Third 

Fourth 

Fifth 



ATTITUDES AND VALUES 

First • ♦ 

Second 

Third 

Fourth 

Fifth 



m SATISFIED , m m m tse level 

OF mWGE ^. SULL OF STUDESTS IH , 
RSLATIOH TO mSE OB^CTIVES? . 



KNOWLEDGE OF JOB CHARACTERISTICS: 

Very satisfied 
Satisfied 
Dissatisfied 
^ery dissatisfied 



KNOULEDGE OF JOB REQUIREHENTS: 

^Very satisfied 
Satisfied 
Dissatisfied 
Very dissatisfied 



'24 


31 , 


33 


33 


11 


13 


27 


23 


24 


22 


37 


13 


17 


23 


. 10 


0 


16 


25 


17 


12 


10 


22 


21 


38 


15' 


12 > 


24 


22 


16 


13 



26 

17 / 
9 

24 



23 


10 


33 


42 


25 


23 


43 


0 


16 


13 


15 


19 


22 


21 


25 


0 


10 


11 


11 


13 


39 


19 


33 


.11 


.25^ 



3 


0 


0 


11 


0 


0 


51 


54 


52 


44 


'53 


38 


42 


39 


43 


44 


37\ 


63 


5 


8 


5 


0 


11 


0 



7 


4 


0 


0 


16 


0 


49 


42 


57 


44 


53 


38 


42 


50 


43 


• 56 . 


21 


63 


3 


4 


0 


0 


11 


0 



s 



. Questlonnaire-lteii 



• CAREEft DECISION HAKING 

Very satisfied 
Satisfied 
Dissatisfied 
Veiy dissatisfied 



BASIC SKILLS 



r 



TABLE 10' 2 (continued) 



Very satisfied ' 
Satisfied 
Dissatisfied 
Very dissatisfied ' 



AniTUDE AND VALUES 

Very satisfied 
Satisfied 
Dissatisfied 
Very 4j^at1sf1ed 



INDICATE THE m MAJOR UAYS IN WHICH 
THf CAREER ANO OCCUPATIONAL DEVELOPMENT 
PROGRAM AT YOUR SCHOOL COULD BE IMPROVED. 

More guidance counseling personnel 
More Inservlce training for guidance 
personnel 

More Inservlce training for teachers 

More career education classes 

More Infusion of career concepts Into 

other courses 
Better materials ' 
More Innovative learning experiences 
Other 
More 



Total 



2 

53 
42 
4 



9 

60 
28 
i 



10 
56 
29 
4 



18 
19 

43 
17 
61 

9 
18 
7 



4 

31 
4 



8 
39 
46 

8 



5 

62 
33 
0 



5 

71 
19 
5 



Region 



1 2 3 4 5 ."6 





0 


0 


0 


0 


9 


42 1 


52 


■ 56 


68 


38 


57 


50 


43 


44 


26 


63 


35 


8 


5 


0 


5 


0 


0 



0 

67 
33 
0 



11 
68 
16 
5 



0 

63 
38 
0 



26 
48 
26 
0 



\ 



11 
44 
44 

0 



11 0 

74 63 

11 25 

5 0 



22 
48 
30 
0 



2t 



Kind of Comnunjty 



1 ■ 2 3 4 



0 

45 

50 
5 



5 

60 
35 

a 



10 
50 
35 
5 



0 0 
54 55 



8 



3 



0 

69 
31 
0 



5 

63 
30 
3 



0 

69 
23 
8 



8 
53 
38 

3 



19 


29 


22 


16 


13 


9 


20 


15 15 


19 


14 


11 


26 


25 


17 


40 


•15 


35 .: 




44 


32 


13 


61 


50 


39 45 


4 ' 


'19 


33 


21' 


38 


13 


5 


15 10 


54 


52 


56 


74 


88 


61 


45 


69 73 


J9 


0 


22 


0 


13 


9 


5 


15 15 


31 


24 


0 


21 


13 


/I 


25 


15 18 


8 


0 


11 


5 


0 


13 


5 


0 8 


12 • 


10 


0 


5 


0 


13 


5 


15 8 



6 

55 
36 
3 



r 



21 
55 
21 
3 



18 
58 
18 • 
3 



21 
18 

36 
33 

55; 

3 
15 
9 
9 
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TABL5rl0.2 (continued) 



Questionnaire Item 



\ Vuesiionnaii 

\ f 

SHOULD /(LL STUDENTS NEET A HINIMUH 
ACHIEVEMENT LEVEL IN 'READING. WRITING, 
AND MATHEMATICS AS ONE REQUIREMENT 
FOR HIGH SCHOOL GRADUATION? 



Yes 
No 

Not sure 



WHICH OF THE FOLLOMING SHOULD SET 
THESE STANDARDS? 

Local education agencies 
\State board of education 
Legislature ' 
Both local agencies and state board 

of education 
Other . , 
None of above 



IS YOUR SCHOOL AN ESEA TITLE 1 SCHOOL? 

Yes 
No 

No response 



Total 



76 
12 
10 



3S 
9 
1 

48 

3" 
3 



/ *3 
4 48 
9 



HOU DO YOU RATE PARENTAL SUPPORT OF YOUR 
SCHOOLS POLICIES AND PROCEDURES? ' 

Excellent 
Good 

Average > 

Fair 

Poor 



15 
56 
20 
1 
3 



11 
8 
15 



23 
12 

"0, 
54 



8 



15 
46 
23 
12 
4 



33 
19 
0 

48 



42 33 

46 ~ 62 
12 5 



19 
57 
10 
5 

10 



Region 



33 

a 

11 
56 

0 
0 



22 
67 
11 



0 
78 
11 

*n 

0 



0 
5 



68 
32 
0 



16 
53 
32 
0 
0 



• 5 



81 89 ' 84 ' 63 
14 0 5 13 
5 11 5 25 



32* 50 

5 13 

0 " 0 

58 25 



13 
0 



25 
75 
0 



25 
50 
13 
13 
0 



65 
26 
9 



48 

0 
0 
39 

0 
9 



35 
17 



13 
61 
22 
4 
0 



Kind of Connunlty 



12 3 4 



75 77 
15 
10 



20 

0 
0 

60 

10 
5 



5 

45 
40 
40 
0 



39 

0 

' 0 
54 

0 
0 



60 39 
40 54 
0/ 7 



23 
46 
8 
8 
15 



70 85 
15 6 
13 9 



45 30 

15 , 9 

0 ^ 3 

38 52 



30 
60 
10 



18 
58 
20 
5 
0 



.52 
36 
12 



15 
64 
12 
6 
3 



TABLE^0.2 (continued) 



Questionnaire I ten 




HOH 00 you RATE STUDENT AHITUDE 
TOHARO SCHOOL AND LEARNING 

Excellent 

Good 

Average 

Fair 

Poor 



FIRST QUARTER PERCENTAGE OF ATTENDANCE 

58-!H 
92-98 

No response 



SECOND QUARTER PERCENTAGE OF ATTENDANCE 

S3-89 
90-97 

No response 



HOW AVAILABLE ARE CAREER EDUCATION 
COURSES? 

Generally 
Sooiewhat 

To a fflinimum extent 

Not available ' 



, 8 
I 61 
24 
7 
I 



32 
56 
12 



39 
49 

12 



15 

i 



50 
39 
11 



54 

39 
7 



10 
62 
14 
10 
5 



33 
48 
19 



24 
52 
24 



Region 



0 
78 
'22 

0 
0 



0 
78 
22 



33 
44 

23 



0 
64 
11 
5 
0 



26 
68 
6 



37 
58 
5 



0 
75 



75 
13 
12 



9 

57 



25 ♦ 30 
0 4 



38 26 
50 65 
12 9 



26 
65 
9 



73 


73 


67 


67 


79 


38 


87 


18 


12 


29 


33 


16 


13 


13 


6 


8 


5 


0 


0 


38 


0 


4 


8 


0 


0 


5 


13 • 


•0 



0 
55 
' 30 

15 
0 



60 
20 
20 



60 
25 
15 



Kind of ConmiyiUy... 



2 



8 

46 
23 
15 

8 



54 
39 
7 



62 
31 
7 



3 



15 
65 
20 
0 
0 



10 
75 
15 



18 
68 
14 



42 
49 
9 



75 


85 


68 


73 


10 


15 


23 


18 


5 


0 


6 


6 


10 


0 


3 


3 
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principals of 17-year-olds were asked to respond in relation to thetr 
el^Sfl'^grade students. 

The chapter concludes wi^h a profile desci^blng the outstanding 
differences between students and schools in Big Cities versus Residential 
Suburbs. 



Summary of Results 

Objective- referenced instruction . Principals were asked to rank order 
the objectives assessed by the test in terms of instructional emphasis in 
their schools and to indicate their satisfaction with student achievement 
on each one. 

Considering ,the five objectives as ranked from 1 = higHes't to 5 -, slow-- 
est emphasis, the objectives .were ranked, on the average, by principals as ' 
follows: « 



High School Principals 



Middle School Principals 



1. Knowledge of Job Requirements 1. Attitudes and Values 



2. Basic Skills 

3. Attitudes and Values 

4. Career Decision Making 

5. Knowledge of Job 
Characteristics 



2. Knowledge of Job Requirements 

3. Basic Skills 

4. Career Decision Makinq 

5. Knowledge of Job ^ 
Characteristics 



Between 66% and 69% of high school principals were either "satisfied" 
or ^"very satisfied" with achievement on Attitudes and Values and Basic , 
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Ski4Js, while only 54-56% felt this way with regard to the other three 
objectives'. This discrepancy was even more substantial at the middle 
school level, where 62-70% were satisfied to sOme degree about Attitudes 
and Values and Basic Skills but only 36-46% felt as such regar^ling the 
other three objectives. * 



Ways to improve the career education program . Principals Were asked 
to cite two major ways in which the career education, programs in their 
schbols could be improved. Principals tended to select answers which 
favored the integration of career educa^tion into the regular curriculum, 
rather than the separation of such instruction from students' day-to-day 
school experience. About 60% of all principal s^advocated "more infusion 
of career education into the curricula of other courses," and about 40% 
desired "more -insfervice training for academic teachers regarding career 
education." Just under 20% of principals of 17-year-olds indicated a need 
for more guidance or career counseling personnel r more career classes, and 
more innovative methods^ slightly more principals of 13-year-olds cited 
these needs. In addition, 1'9% of middle and junior high school principals 
and 11% of high school principals cited a need for more inservice training 
' of guidance staff in career education. ' 

Minimum achievement standards . . At both age. levels, more than three 
out of four principals responded "yes" to the question: "Do you believe 
that all students must meet some specified minimum standard of achievement ^ 
in reading', writing,' and mathematics as one requirement for the awarding of 
" the high school diploma?" {79% and 76% for principals of 13- and 17-year- 
olds, respectively). 



■ 1^ ■ 
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The overwhelming majority of principals felt that, if minimal 
competency Standards were to be used as a basis for high school graduation, 
the local educational agencies should have eome responsibility for setting 
those standards. About one- third of all principals felt that the respon- 
sibility should rest solely with local educational agencies, while another 
50% replied that the local agencies and the State Board of Education should 
share that responsibility jointly. Only about 9% of the princiB§ls at both 
age levels replied that the State Department of Education should have sole 
responsibility for setting standards, and only l%,of the principals indi- 
cated that the state legislature should set minimal competency standards-. 

^ ■ ■■ . ^ ■ ' 

■ School participation in ESEA Title I program . Just under half of all 

prihcipals replied that their schools receive ESEA Title I funds. 

Parental support of/the school . Approximately three of every four 
principals rated- parent support of their schools as "good" or "excellent," 
while very few (5% and 10% of principals of 13- ar\d 17-year-olds, respec- 
tively) rated parental support as either "fair" or^'poor." 

Student attitude toward school . Very few principals (2-8%) described 
student 'attitude toward school as either "fair" or "po^r." About 70% ^ted 
Student attitude as "good" or "excellent." . 

^ School attendance . Almost 83% of the middle school principals reported 
that their schools have an average first-quarter attendance rate of 91% or 
better, but only 69% reported this high a rate for the second ^quarter. At 
the high school level, 77% of the principals reported f irst-qu&rter 
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attendance at 91% or above, while just under a half reported this 
attendance rate for the second quarter. 

Availablll ty^of career courses . Abiit three-quarters of principals 
of 17-year-olds responded thai career courses were "generally" available at 
their schools, while another 18« said that these courses were "somewhat" 
available. (This question was not asked of principals of 13^year-old 
studentsO 

Profile of Students and Schools In Big Cities " 

Results reported earTler Indicated that Big-City studeijts tefided to 
score below the statewide averaV. while students In ItesldenttM v Su*)tirbs 
tended to score above the statisWide average; An attempt was made to 
Identify characteristics of Big-City schools that may con^ibute to 
differential assessment In coro|t>ar1son to students In Residential- Suburbs. 
The resultant "profile," based on responses to the principal and student 
questionnaires. Is presented below. 

In comparison to Residential Suburbs^ Big<Ci-Hee are places In whic 

• the proportion of 17-year-olds In the ninth or tenth grade is 
larger. > 

if ■ , 

• students are likely to be given drlM work or reading and writing 

assignments less frequently. - 

. • 13-year-olds are more likely to discuss th^r career pi ansjith a 
guidance counselor/ while 17-year-olds are less Tlkely^tlo so. 



17-year-olds are less likely to have taken a career aptitude test, 

' V;'/ ' 

a larger proportion of parents of scho61-age children work in low- 

♦ ' ". ■ . • ' ■ 
status occupations. 

students are less likely to aspire to h1gh-stat:us otcupatlons^ 

parents of 17-year-olds are less likely to encourage postsecondary 
education. • . '. . ^ ' 

stuidents are less Tikely to plan on attending a four-year college.^ 

a Wger proportion of ^-year-olds are enrolled in vocational 
pro^rams-andparticiofete in work-study programs. 

principerls are less likely to encounter "excellent" or "good" 

, *■( % . • 

parental support of the school and student attituties tovArd school 



the average attendance rate in each quarter tends to be lower. 



i. * 



> ■ 
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C H A> P T E R 11 
RESULTS OF THE BENCHMARK PANEL 

, ■ ; \ ; ' ■ 

. fntroducti on 

The purpose of this chapter Is to present the results of the Bench- 
mark Panel on Career and Occupational DevelopmeTT^ The panel consisted 
of educators, school administrators, and business representatives from 
throughout Massachusetts. Their task was to compare the actual test per- 
formance of Massachusetts students to their own "benchmark" of desirable 
.achievement. Through a process of discussion on. each Item, the panel 
at;tempted to reach a consensus of opinion on whether or not additional 
emphasis ought to be placed on teaching" students the skills- measured by 
ttjat item,^ "Consensus . of op,1n1on" was defined as the agreement of at leasj^ 
two-thirds of th6 panel members. , 7^ 

' " * . . ) ' 

Suitinary of Results . , 

Table 11.1 shows, for each age level, the percentage of Items for 
each objective on which there was "consensus" among panel members that more 
-emphasis was required, and the percentage of t terns for which additional 
emphasis was not necessary. Also shown Is the percentage of items In each 
objective for which the panel members could not reach a consensus (I.e. , 
more than one- third tjut fewer than two thirds felt that more Instructional 
emphasis was required). 
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TABLE U.r 

Results Of the Benchmark P?nel : 
Consensus Opinion of Panel Members* 





Totccl 
Number 
of Itema 


Percentage of Items 


Objective 


More 
Emphasis 
Necessary 


No More 
Emphasis 
Neciessary 


' Undecided 








• 




- n 

13^YEAR^0LDS: 








•J' 


1, Job characteristics 




24 


71 


S. 


2. Job requirements j 

3. Career decision making- 


■30 


3^ 


30 


37 


27 


48 


0 22 


30 


4 Basic skills 


18 


11 


67 


22 


R Atti tuHpQ -and val ueSi 

k - 


27. 


18 


71 


12 


* 






r 




Job chdracteristijcs 


21 


.24 ' 


67 


10 


yZ. Job requirements. 


:30 


17 


.57 


27 


—a^^areer decision "f^pQ 


27 ' 


44 


30 


26 


.4* Blasic skills \ 


IS 


11 V 

. * ■ \ 


83 


5 


5. Attitudes and Values 

1 


17 


18 


76 


6 




^♦Participants responded to the following question: 

G1 veil the percentage of Massachusetts students answering this Item cor- 
recWy. do you feel that more emphasis ought to be placed on teaching 
students the skills measured by this item? 

fsensus of opinion Is defined as the agreement of at least 2/3 of the 
"participants. * 
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TJhe Benchmark Panel members felt that the most emphasis ought to be 
placed on teaching both 13- and 17-year-olds the skills necessary to make 
career decisions (Objective 3), This objective showed the highest percent 
age of Items, on which additional emphasis was felt to be required. The ' 
panel also felt that 13-year-clds, In pjrticul^r, should be given ajidi- 
tlonal Instruction in the kinds of abilities, training, and preparation 
required' for various careers (Objective 2). It was the opinion of the 
panel that students at both age levels were receiving sufficient instruc- 
tion overall in the skills measured by the remaining three objectives,, 
although there were at least a few items In each of these objectives about 
Which they expressed concern. 
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APPENDIX A 



Copies of Test Items for 13- and 17- Year-Olds, 
with Corresponding Percentages of All 
Students Selecting Each Response 




KEY FOR APREN&IX A 



OBJECTIVE NAME 



Questiort as It appeared In test, 
including the itemv number 
(reduced sl^e) 



y Numbers 
corresponding 
to choices 



• The correct response is darkened 
for multiple-choice questions 
and entered on the line for 
open-ended questions^: 

« 

*• Complete desiriptions of the 
NAEP criteria for scoring' 
open-ended Items appear in 
Appendix H. >y 

y ■ ■■ V • ■ 

• Where the percentages of students 
selecting all responses do not 
add to approximately 100%, the 
^remaining percentage of students 

. made no response. 



\ 



Age level 
13 17 



1 
2 
3 
4 



% 
~% 
~% 



Percentage 
of studenfs 
selecting 
each 

response 
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OBJECTIVE 1: JOB CHARACTERISTICS. nm^^m 13 17 







• 






1 




In QuMlont 5 to 7. thrtf ptopit dMCiflbi thi woflc thty do. Rttd mqH dMcHption iod th«n 
writ* tht nam of th« worktr'i job on th« lino provided. 

• 








* 


* 

i- 


1 Mt up and opmta machfnt tools and 1 fit and ammbla paf|« to maka or rtpair matal 
pare, machaniimt, tooli or machlnat. \ havt to undamand maehaniei, #foo maih and 
propartiai of matatt. t mm b* abia to raad bluaprlnti. ikatehat or daacrlptiont of tha 
parr 1 am to raplaea. What it tha nama of my job? 

ANSWER (1) machinist, metal engineer, etc. 


1 




26% 






(2) incorrect response 

• • - 

.% ^ 

f * ' ' ■ 


2 


SIX 


66% 




6. 


> V 

1 dnian building! and organza tha larvicM nacanary for tha4r conttructfon. ftm 1 
consult with myv cliant to frnd out what hit 4>aca raquirarT>antB art and to jiva him tha 
information ha naadt about cott. daalgo. building timt and to forth. 1 praparo tkatehai 
/•f^Jpniatimat modalt of tha propotad dntgn for my cliant, What it thi nama of my 




t 




□ 


ANSWER: (l) archltcct, etc. 


1 


71% 


80% 






(2) incorrect response 


2 


24% 

» 


17% 




7. 

□ 


'J 

1 racaiv* and pay out monay and kaap rtcordt of bank trantactiona. Whan 1 racttva 
ehaekt and cath that cuttoman warn to dapotit 1 varify tha amount and maka lura 
th« chacks hava baan andortad. 1 maka anthaa in dapotitoft' patibookt or tita i^ut 
* racaip'ts. What is tha nama of my job? 

• 


• 


■ 


\ 
t 




ANSWER: ( l) bank teller, cashier, etc. 


1 


522 


68% 






(2) Incorrect response 

"if ■ 


2 


45% 


30% ; 

i 

I 



OBJECTIVE 1: JOB CHARACTERISTICS 



Ratponw 13 17 



eh pcnon uiMAlly wni tht moit montyif 
t # plumbtf 
3 O tMi driv#f 

8 O ( dof^'t know. 



ERLC 



9. Which ptrton uiuaily tarnt th« moit morwy? 

t # MCffury 

2O tt1iphon« operator 

3 O nunat' aida 

4 O noradark 

5 O ' do"'t know. 




ia Which ona of tha following jobs raquim haavy Mfting. crawling and 



1 % automoblla rapairman 

2O itltiman 

30 barbar 

4 O railroad anginaar 





S ^ I don't know. 



J33 



1 
2 
3 
4 



1 
2 
3 
4 



1 
2 
3 
4 



56% 
16% 
3% 
12% 

13« 



81% 
8% 
IX 
4% 

7% 



46% 
13% 
20% 



58% 
12% 
12% 



6%-. .4% 



15% 



14% 



82% 
1% 
. 0% 
14% 

, 2% 



87% 
1% 
0% 

10% 

1% 
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Shown Mow am tl«vtn diffortnt oeeupottoni and four difteranrvoeational arfai Into x^ich 
ihf occupation! can ba groupod. NoMt to aaeh occupation, fill in ont circle to tfiow tha 
vocational area In vvhich that occupation ihould bo groupod. 



OCCUPATION 



VOCATIONAL AfllA 



Skilled 
Sifvlooi 



Skilled 



HMitt) 



134 



Saiaa 





. Jawalry makar 


'O 


>e 




•0 




Iniarfpr dtflgnar 


•0 


»o 


'O 


•0 




Sarbor 


'O 


»o • 


»o 




ts. 


Auto mechanic 


. '0 


»0 




*o 


16. 


Stofo derK 


'0 


»0 




'0 


17. 


PhyskaJ therapitt 


'O 






•0 


18. 


TV repairpefion 


'O 


»o 


>0 


• -0 



15. 



16. 



17. 



18. 



1 
2 
3 
4 



1 


44X 


2 




3 


39« 


4 


ax- 


\' 


70* 


2 


27X 


3 . 


0% 


4 


1> 


"1 ■ 


5« 


2 


2« 


3 


1« 


4 ; 


QIX 


1 


9% 


2 


2X 


3 


87% 


4 


0% ! 



71% 
26% 
0% 
Z% 



m 

\2% 
37# 
1« 

75« 
24% 

.oj; 

. o« 

4« 

n 

0% 
94:( 

in 
n 

873; 
0% 

78% 
20X 

0% 

1% 
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, VOCATIONAL Af1|A 








OCCUPATION 


Skills 

SSOifiD 


SkllM 


H««lih 






19. 


Intufioct 9f9^X 


'0 






*• 


19. 


20. 




'0 


>• 




«o 




21. 


0«fntl Miinint 


'O 




. >• 




20. 


22. 


Mm broktf 


'O 


lO 


>o 


«• 




23. 




'O 




>• 






24. . 


Fumiturt maktf 


'O 




'0 


*0 


21. 



22. 



23. 



24. 



1 
2 
3 
4 

1 
2 
3 
4 

1 
2 
3 
4 

1 
2 
3 
4 

1 
2 

4 

1 
2 
3 
4 



19X 

r 3X 

n 

70X 

25X 

70% 
U 
2% 

m 

79% 
OS 

16X 

•211 



3X 
3X 
t 



lOX 
86X 
IX 
3X 



r. 



7 



I 
) 
I 
j 

13X 
2X 
4X 

BIX . 

25X I r 
73X 

OX 

IX 



13X 
2X 

84X 
OX 

)2X 
IX 

• OX 

sex 

2X 
IX 
95X 
IX 

6X 
93X 
OX 
IX 



i , 

t 

t 

I * 



t 



I 
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] 


39. 


Which of th# following oteupttiont wouM allow • ponon to bt mm\ fm ^rom xh9 
c$n «nd worry iiivol>^ in luporvit^ng othtr worlifri on thf job? 










> 

< 0 ^orimin 

a 0 cllroctor df optratlont * 

3 0 alrlino pilot * 

4 # tMchor 


1 
2 

3 - 
4 


25t 
lit 
25t 
39t 


13% 
8% 
28% 
51% 


4a 


Which ol tho following occupitionf would prc^iilo • p#r*on with tho grtttvit rttponte 
Mllty iDr eontrolting md dirtcting othtn? 










t 0 ^^^f 

2 # Ihip't Ciptain 

3 Q ptciomioi fnimgor 


1 
2 
3 
4 


42% 
28% 
19% 
10% 


40% 
33% 
19% 
7% 


41. 


Which of ihtf^llowing oocup«tioni would provldo • ptrvon with tht mo«t ind«p«ndtnc« 
on int joor 










1 # tncMr 

2 0 draftipofion 

3 O wortctf 

4- 0 tetory production lint worlctr 


1 
2 
3 
4 


23% 
18% 
51% 
7% 


20% 
18% 
58% 
4% 




Which oceupotion would probtb«y provide a ptnon with tht highttt incomt? 










tO liborttory itchnkitn ( 

3 A eMI trtaiMtr ^ 

4 0 COOlt 

» • , - . - 
f 

■ * * 


1 
2 
3 

4 


13% 
59% 
22% 

Kb l« 

4% 

I 


5% 
56% 
35% 

3% 
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i 


• 






















Which on« of the following jobi rtquirti good color vision? 










1 engiisn nicncr . ^ 


1 




1 a/ 

1% 




chemitt 


2 


S7% 


92% 




3 O inachinift V ... 


3 


3% 


3% 




4O l«wyBr 


4 


1% 


0%. 




sO i don't know. 

< ■ . - 


5 


7% 


4% 


12. 


For which on« of tha followtng jobs is good eyMight imporunt? 






• 




.1 % watch repairman 


1 


86% 


94% 


m 


2 0 grocery store clerk 




7% 


2% 




3O ianitor 


3 


1% 


0% 




4 0 gas ^ion attendant 


: 4 


3% 


1% 




5 0 ^ don't know. 


5 , 


4% 


2% 


13. 






1 




On which one of the following jobs U It imponant to work fast with your fingers? 




1 
1 






v Q clothing store salesperson 


1 


i 

3% 


2% 




2 0 policeman . ' 


9 


OfO 


1 AO 




3 % secretary 


3 


92% 


96% 




4O i«nitor • 


• 4 


1% 


0% 




\0 ^ don't know. . : ^ - 


5 


1% 


1% 
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1 






For each of the nine occupatro^ 


listed below« fiti in one circle to show what education or 










training is usually required for that occupation. 
















♦ 




> 








( • 
















\ ■ 










1 Hlgh^. 


V UW« ilUI Hil * 




r our T oais 












School 


Technical 


Apprentice- 


or More" 










OCCUPATION 


or. Less 


School 


ship 


of College 




' • . ■. . ' 


' ^ 




Examgie: 




' ■' ■ 




• ■ 










. : . ■ • . ... 






3.0 
* 












27. Waitress^waiter 


<• 




30 




27. 


1 


79% 


< * 

91% 














.2 


9% 


-31 


28 Glass h{Q^M^r 


1 O 




3 • 






A 
C 


• 10% 

, 1% 


.4% 
0% 


29. Hospital attendant 




2 D 




\ n ■ 


28. 


■ 1 


»iO% 


9% 


. ■ \ ■ ■ 












. ♦ 2 


34% 


26% 


30. Social worker ' : 






3 Q ■ ■ 




«■ 


3 


51% 


62% 














4 


. 4% 


'1%. 




: i . 








.29. 


1 


. 11% 


23% 














2 


41% 


43% 














> 3 


■ 9% 


9% 














4 


38% 


24% 












30. 


1 


17% 


14% 










1 




2 


15% 


9% 


• 












3 


13% 


-6% 
















53% 


^70% 










/ XT • 










. ■■ . . ' ■ . ^ 
' f 






















■ • 
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ERLC 



... . IN- 
OCCUPATION 



31. Air fondlttoning and 
rt frigtfttion m«clijnie 



3Z aiaeksmitfi^ 

33. Phkrmadn 

'34. AulbmoA>iicj4lMp«rtQn 

35. EnginMT 




Vocational- 
Ttchnical 
School 



Apprtniict* 



30 



30 
3 O 



Four.Yttrt 
or Mors 
of Co lttqt 



.*0. 31, 



33. 



34. 



,35. 



1 
2 
»3 
4 

1 

3 
4 

1 
2 
3 
4 

1 
2 
3 
4 

1 
2 
3 
4 



42 


. 1% 


66% 


81% 


.15% 


12% 


13%' „ 


"5% 


15% 


9% 




isr- 


59% 


71% 


/3% 


,1% 



43% 
23% 
22% 
11% 

' 3% 
42% 
10% 
44% 



1% 
6% 
•4% 
87% 

52% 
16% 
21% 

1Q% 

< 

1% 
32% 
6% 

,59% 
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36* 



Which ont of the following jobs usually rsquirts tht LONGEST period ofyreining? 

1 Q manjcunst • \ 

2 plumber 

3 0 swembly Hne worker ^ . 

4 O trtick driver ( ^ 

5 O I don t know. 



L 37. 



ERIC 



Which one of the following jobs usually raqufres the LONCJEST period of training? 



t lawyer 

2 O computer operator 

^ 3 O electronic achnician 

4 O insurance salesman . 

is O know* 




< < 



3a Which one of the folfowing jobs usually rojlijres the LONGEST period of training?^ 

1 .# registered nurstf ^ 

* 2 O P'^cticel nurse • 

3 O ^©•P'ttl orderly o . 

* O ^"^y technician* 

s O • don't know. 



140 



1 

2 

3. 
4 

5 . 



1 
2 
3 
4- 



18%; 
53% 
11% 
b% 

13% 



\ 



64% 
9% 
20% 

.1%. 

6% 



7% 
75% 
'4% 

4%1- 

10% 



79%: 

4% 
12% 
0% 

5% 



1 
2 
3 
4 



48% 
3% 
- 4% 
35% 

9% 



(52% 
* 2% 
1% 
29% 

6% 



1 
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Listed b«low jire eight different jobs and eight kinds of cheracteristics people need In those 
jobs* In the blenk' space n^xt to each job, write the number of the one characteristic that you 
think is MOST irhportant for that job.*'Only one number should be written In each bfank, and 
every nurhber should be i/sed. ' ^ 



OCCUPATION 

f^adio announcer 
Poli^ officer 



3\ 



^l^retary 



Butcher 
Bus driver 
TV repairperson 
. Receptionist 
Draftspersgn, 



CHARACTERISTIC 

1 Spatial relationsh ips 

2 Friendliness 

3 Fairnpss/ 

4 • Fluent /speech 

5 IVI/muiU^xterity 

6 Cleanliness 

7 Alertness * 

3 Careful listening 



• 

Item 


Age 


Percentage of Students ^yftioslng Each Response « 


1 


2 


3 ,^ 


4 


5 • 


6 


7 




42 


i 

13 


3 


9 


1 


77* 




1 


1 


5 . 




17 


2 


4 


1 


8^* 


0 


0 


0 


2 






r 
















43 


13 . 


4 


ir 


41* 


1 


■ 2 


1 


37 






17 


4 


5 


63* 


1 - 


•2/ 


0 


23 • 


* . • . ■ 




13 


12 




4 


5 


10 


7 


6 


40* 




17" 


13 






* 2. 


• 17 


7 


6 


. 37* 


.45 


13 


6 


4 


8 


1 


7 


70* 


2 


1 


« 


17 


4 


3 


4 . 


0 


6 


78* 


2 


1 


46 


13 


13 


24 


11 


2 


7 


^ 2 


34* 


5 . L 




17 


10 


,15 


6 


1 


5 


1 


58* 


3 . . * 


47 


13 


17 


8 




2 


,40* 


4 


6 


9 




17 


17 


7 




1 


43* 


1 


5 


15 f 


48 


.13 


14 


26* 


. 7 


8 


5 


7 


■ -5 


25 






9 


48* 


Z . 


5 ' 


2 


4 


2 


25 ^ 


49 


13 


26*- 


3 


14 


3 


26 


7 


7 


10 




17 


. 37* . 


2 


10 


1 


27 


6 


5 . 


11 










• n , 
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54. 



5S. 



John hn outlintd a eounii that includat fnany mathamaties anfl flnt arts (an) daam. 
Thaia ara alio hit bttt cTami. Ht p4ani two yaars training btyond high KhooK This 
program will prapara him ai: 



1 O •tfft 

2 9 a drafjcsparabn 
30 > taachar 

4 0 architact 



) 



r • 



Sua hat chosan a caratr in law anforcamanr Sha plans ^to en tar as a pojica officer. 
Tha most appropriaca community activity for Sua would ba: 

1 O intarviaw polica offlcan ' 
3 # part-tima or voluntear work at polica dap^^ant 

3 0 YWCA dub work 

4 O ittand munldpaJ court sasaiona 



142 



1 

2 
3 
4 



23% 

26% 
5% 

46% 



1 

2 1i 
3 
4 



14%, 
73% 
3% 



13% 

38% 
3% 
46% 



10% 
81% 
3% 
5% 



~0BaECflVE"*2r JOB REQUIREMENTS 
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E«di of tht five occupitions listtd Mow rtquirM^fomt^knowltdgt of mitherhytie^ Some 
of the occupitions require oi^jy gentral methemttia^ arij^ lome require a knowiedQe-of ver/^ 
advanced mathematics. Next to each' occupation, fill in one circle to.indicate wh^er that 
occupation requires a knowledge of ^eral mathematics or advanced mathematics. 



OCCUPATION 

Examples : 
Carpenter 

Astrononier 



84; Sales clerk 



•> 



7 



85. 
87. 



Electrician 
Engineer 
Bank teller 



V 



88. Meteorologist (weather forecaster) 



MATHEMATICS REQUIRED 



^General 
Matnematics ' 



o 



AdyancM 

Mattitfn'atio 



20 



20 

* zQ 

2e 

20 



y84. 

85. 
86. 
87. 
88. 



1 
2 

1 
2 

1 
2 

1 
2 

1 
2 



79% 
20% 

37% 
'62% 

31% 
68% 

48% 
51% 

29% 
70% 



91% 
8% 

37% 
62% 

9% 
90% 

X 69% 
\30% 

21% 
78% 



■ O 7 

ERIC 
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4. Utt five difftrant thingt that a parson ihould think about in chooaing a job or carear. 

<1) " one correct' response • ..a' 



S% 



2% ! 



(2) two correct responses 



9% 



5% 



(3) 



J*) 



three correct responses 



four correct responses 



17% 



23% 



11% 



16% 



(5) five correct responses (mastery criterion) 



41% 



64% 



ERIC 
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26. ., Suppott you want tp find out mon about a Job you art jntaranad in. What are fiva 
thingi you could do HOflf to fl/id out-fnora about, tfit job bofora you taka tha job or 
ba9in job trainiftg? . > . 



(1) one correct response 



(2) 



(3) 



(4) 



(5) 



two carrect responses 



three or more correct responses (mastery criterioriT 



145 



12% 



16% 



.48% 



7% 



14% 



65% 
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In QuwtlOM SO and 51, you arit givtn somt information about a person. Then you are given 
four statements about his 6r her future career. From ttie information given, choose the ONE 
statement that you think is best for that person. , . 



50. 



51. 



Oiane does a lot of wood shop work at home and a^ takes shop courses at school 
She hat made several professtonal-looking cabinets and has won a prize for one in a 
citywide contest She is now trying to decide if she has enough skiii to continue with 
cabinetmaking. 

What do you think? 

' The work she has lone suggests that she has above-averaoe cabinetmaking ^ill 
and interests. V, 

2 O If her -friends thjnk she has cabinetmaking skill, she probably does and should 

continue making cabineo. 

3 O She should plan carefully, since she may not have enough 'skill :o be 'a successful 

cabinetmaker later on. 

*0 She has skill in making cabinets, and she should iiso design them. 



Warren lives near tt?e ocean and is fascinated by it, )ust summer he worked as a 
busboy at one of the nearby resort hotels, and this surfimer he'll be a ba^rboy on one 
of the deep^sea fishing boats. After h,gh school, he is t/inking of becoming a merchant 
seaman. He knows they, make good money, but he Wasn't know if he'd (ike being at 
sea for sometimes as long as six months. 

What do you think? ' 

^ O He should depend on his father's judgment ahyqui whether he should go to sea. 

2 O He sounds like a born seaman. He'll probably work h£s way up1n rankfluickly. 

3 O No n^iatter how much more he found out abouriivingat sea, he couldn't be sure 

he would really like it/ ' ^ 

• He should get some more ififormatitfc and experience. He mig'^t sigrTon for a 
summer cruise as a cabin boy and see hbw he likes it. 
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1 

2 

3. 
4 



1 » 

2 
3 



2% 
6% 
17% 

74% 



42% 


58% 


7% 


4% 


31% 


25% 


19% 


13% 



1% 

3% 
9% 

86% 



OBJEaiVE 3: ^CAREE^ DECISION MAKING 



liv Qumiom $2 ^mtS3, tfw ftorlii d«Krib« a | 
four itaw nt im about ihingi that ht oriht iho 
tht ona na t a man t thai you think it tmt for i 



that fomabody hat, Than thara am 

From tha infomrmioh ftvtn, choota 



53. 



S3. 



EKLC 



Elalna wants to ba «i anglnaar and Ml tha ability to ba ooa. But har gradat m>tt>r, 
and iha thinkt iha may not gat intoKollaga.' y/, , 

VVhatdiould tfw do? 



2 % talk with har taachan or a coumaior 

3 O ''^^ A ^ oollap'inpit* har gradaa, bacMta tha hat tha 
< O ehanga %r occupational choiot to aomathing alaa that doasn't rtquii 




Max hat avaraga gradat in hi^^ school and could gradidb in anothar two yaars. But ha . 
it tirad of school, and would Ilka to gat a full-ttnr)a job. , 

What dioyld ha do? . ^ - ■ . 

1 O join tha Army 

2 O continua h^ aducation ^ ; 

3 # talk with othm (dropouts, tmployartr atci about what ha should do 

4 O 'u'l 00 to ichool tt night 



147 



1 

V 

^ • 



1 
2 
3 
4 



56% 
3756 
4% 



9% 

13% 



17 



49% 
45% 
4% 
2% 




7% 

43% 
42% 
8% 
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You art thinking about talking wiih a quaiifM person about' a carw th«t inttrttts you. 
Bi«i<to aach ttatamant btlow, fill in tht,firjt cin:la if tHt itatamcnt IS a banafit you would 
gain from talking to this pt rion. Fill In tha tacond circia if it fS NOT a baoafit. 







57. 


You would find out about how much you could axpM:t to b« paid in 
that cartar. 


- 






You would find out ioiil| of tha high school coursas that would b« 
uaaful to you in thatcaraar. ' 58. 






.59.' 


Ypu would havf a bmar jda« of tha skills naadad for tha caretr. 


• d 




50. 


You woutd know pars^nally tha ptopta you would ba working with 59 • 
^ftar you flnishad school. 




^0 - 


61. 


You would hav« a^b«ntr idta of chancas for advancamant in tha 



cartar. 



60. 
61. 



1 
2 

f 

^\ 
1 

2 

1 
2 

1 
2 



>8% 
20« 

87% 
12% 

79% 
19% 

29% 
69% 

70% 
28% 



86% 
13% 

91% 

9l'r 
8% 

30% 
69% 

81% 
17% 
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■ » 

■ ! . 
• f 
















78. 


Vyhich of ^ foiiowing is mi "Equal Opportunity Employf?" t^T txptcwd to do? 
















/ 








1 0 hki ptdpit of any ract or crttd 


1 


m 


5% 






2 9 ^^iv Ptopit undar tht aga or lo ^ 


c, 




77* 






3 O ^^'^^ P«op*f on thf basis of abiHty , 


3 


17% 


12% 


f 




4 nira oom man ana woman . • w 


4 


• 7% 


3% 




















1 










• 












» , • • ■ # ■ _ - 










78. 


AH ojffha following^ara fringa banafita EXCEPT: 






, / 






I 0 •hospitalization paymants 


I 


13% 


7% 






2 0 vacation t 


2 


21% 


8% 


9 




3 O • rttirament program . 


3 ' 


13% 


5% 






4 # salary and wagas 


4 


50% 


79% . 


/ 




♦ 












r 










• 77. 


Which ona of tha following js a Social Sacurity banafit? 












■ ^ 

1 O P*i<^ holidays 


1 


8% 


4% 






2 O ovartima pay 


2 


10% 


5% . 






3 O vacation pay 


3 


6% 


3% 






4 9 ratiramant pay 


f 




R7* 


































i 








/ 


1 


1 





f 



OBJECTIVE 3: CAREER DECISION MAKING 



in Mch of th, following (MragrapM you an givm infonn«ion atXMt 4 mi^t From tht 
Htformation gn«n. you are to iMet tfM mo« ippfopri«c»^po«Jbiliti«rfe? ••ch itudwt 



94. 



95. 



96. 



ERIC 



«l« It a high lehool aaflior ««ho ha*.h«d troutXa with weial itudlat and communica- 
tlona wbjaea Sh« h«a always mjoyad iMrking with machanicai objacts and ih« has 
parfomwtf wrti In ^ clasaM. Har hobfaiaa havt ineludad making modal cars and 
atrplanas and taaring dmm and rapairing motors. Sh« can vyoric mote prOblams in 
matf. and algabra but hasn't triad advanc«i math. Har carets piw, mioh*: 
rncluda such |obt ar 

2 O OfdtHv, porttr, cuttoditn . t 

3 O tifctrbnic «ambl«r. ranch hand, nock dark • * 
< # machanlc. plumbar. pattam makar ^ 



.Unda studiad har ichoo* racord and lntara$t and ability tnx tcorat. Sha found that 
iha had axcailant math and sctanca skills, that sha tnjoyad outdoor activttias arvJ had 
suon^ intaram in social san^ica. icianca. and artittic activitiat. Har communication 
skrtU wara not ogtitandlng and sha dItJikad salas and varbal activitias. Reasonabia 
^ carear plans for Linda could includa: 

1 O accountant, author^ chamitt ^ • 

2 0 gaologist, ocaanographar bptanlit 
tQ author, actor, taachar 

4 O librarian, daryyman. raaltor 



Frad's school racord shorn many C's, a faw B's, and no A's or D'v Ka is slightly abova 
avaraga. Ha works tattar with paopla than with things or data. Ha likas/nachanical, 
anfnic, and compytational actlvltin and is good at handling dataiJs. Ha would ba 
axpactad to ba succassful if ha will axplora occupations including tha following: 

^ 1 # accounting dark, cashiar, l^ank tallar / 

2 O num. sociaJ workar, counsalor . ' 

3 0 HC'wary,, racaption*n, salasparaon 

4 O ^ospltd ordariy, portar, hota* ball captain 




loU 
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The following paragraph gives you Information about the abilities and .interests of a student ' 
your age, and lists some possible future occupations the student may consider. Many jobs 
might be appropriate, but from those listed you art asked to select the occupation which 
seefns B£S7 suited for the person described. 



97. 



98. 



Since childhood. Karen has been interested in transportation, and has also enjoyed 
doing things with her hands. She scores high on tests of mechanical ability' has 
excellent eye^and coordination, and is weak in reading and language arts skills. After 
completing high school, she would like to auend a trade school or to find work 
accompanied by an on-the-jo6 training program, 

Qjilphe following occupations, which ONE seems most consistent with Karen's interests 
ano^ abilities? 

10 airplane mechanic 

2 O fTiechanical engineer * . 

3 O *»^ort guard 

4 O director, traffic safety council 



Tom is in his senior year of high schooL His school record shows much success In 
industrial arts subjects. His matir courses have been above average. He h^s had trouble 
with reading and writing subjects. He does not feel very happ9\with^hj;t/i^<cord in 
social studies and science, Tom's school record suggests that hisoposf^high-^hooi (blans 
should include: 



r Q business college 

2# apprenticeship 

3 O fpur-^ear college 

4 O training 



/ 



1 

2 
3 
4 



1 
2 
"3 
4 



■■"■»». 
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IT- 



29% 
44% 
8% 
15% 



41% 
40% 
4% 
13% 



27% 
35%. 
30% 
4% 



?8%. 
53% 
15% 
•3% 
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Bflow is a lilt of occupations. For each occupation, fill in one circle to show whether, during 
the next ten years, that occupation will need MQRE workers or- FEWER workers than are 
needed now. 



OCCUPATION 

Ej(amples; 
^ Accountant 

Dental hygienist 

99. Mathematfctan 
lOa Foreiter 

101. Business machine repairperson 



102. >^ementary teacher 

103, Computer programmer 



# 



104. .Laboratory tech nicia 



10S, Electrical engineer 



•106. Secretary 




MORE 



'O 



'O 



ERIC 

r . ^ *• . ■ 



.ft -■•■t^ 



FEWER 

.' ^e 

:0 99 



20 



100. 



101. 



102 



*0 103 



2 0 



pO - 



■ ■ 'J 



.1 

2 

1 
2 

1 
2 

1 
2 



53% 
43% 

46% 
49% 

67% 
281 

47% 
48% 



48% 
50% 

, 48% 
50% 

76% 
22% 

34% 
64% 




r 



V 



r 
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3. 



A job mumt c«in b«ft b« dtscribtd aj a: 
tQ P'*" ©Miction 

tQ XMk xh9t is staaed more than onc« 

3 9 short panonal and amployment history 

4 O i^^ application laner 



Assume that Tedra fellow employee, has made ioay misukes in his work that he does 
not know about. If the mistakes go uncorrected, they will cause problerps later on. 
Which ONE of the following is the BEST thing for you to do? 

iQ let someone else find jhe mistakes . / 

2O about the mistakes so that the boss can do something about them 

^'^^ Ted unsigned letter describing the mistakes 
4 % talk to Ted about the mistakes and offer to help hjm 



You are a factory wofker and have a co^laint to make about some safety equipment 
which is not being supplied. With whorrSliould yw talk FIRST to try to solve the 
problem? 



1 0 ^<llow workers 

2 % your supervisor 

3 0 the. personnel director 

4 O ^* department 



1 


20% 


2 


23% 


3 


24% 


4. 


29% 



1 

2 
3 
4 



1 
2 
3 
4 



1% 
21% 

2% 
76% 



15% ' 
66% 
15%' 
. 3% 
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Fill in the first circle beside each of the action* described below that IS an IMPORTANT 
example of an interview skill. Fill In the second circle beside each action that IS NOT an 
IMPORTANT example. 



o 

• JO 



166. . being on time for the interview 

67. speaking only when asked % question 

68. answering questions accurately 

69. showing interest in the job 



89% 
9% 



1 I 42% 
2* 56% 

90% 
8% 

90% 

8% 



74. 



^Which question should you ask FfRST during a job inten/iew? 

1 ® "What , kind of pension plan does the job offer?" 

2 (5) "When are the vacation times?" 
3# "What jre the job responsibiiities?" 
< O "How much does the job pay?" 



1 


•7% 


2 


1% 


3 


69% 


4 


21% 



17 



97% ! 

" 2% i 

34% 
65% 

I 

96% j 
3% 

97% 

2% V 



3% 
1% 
85% 
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Bftlow is a bar graph that shows the numbar of traas plantad aiong a highway in a waak. 



100 r 



•g 80 



60 



40 



Z 20 - 



Monday TuMdjy W«dnnd«v Thursdiy 

Day of the Weak 



78. .How many traas ware planted on Wednesday? 

I I ANSWER: (1) 53. 59. 60. 61, or 62 
(2) incorrect response ^ 



79. How many trees werp.planted-on thgrsdav? 

I I ANSWER: (1) 88, 89, SO. 91, or 92 

(2) incorrect response 



80. Hdw hnany traas ware planted on Friday? 

[H ANSWER: (1). 73. 74, 75. 76. or 77 
' (2) incorrect response 



Fridiy 



1 

2 



1 
2 



1 

2 



91% 

75% 
24% 

A 

21% 

78% 



94% 

5% 



81% 
18% 

34% 
65% 
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Mow is • layout of an offlct and shop arta. 




Itfaat 



SHOP 



lafMt 



8^* How many fatt long is tha off lea at SWa X? 

n ANSWER: (1) 10 or 14-4 ' 
(2) incorrect responsie 

How many faat long IS tha office at Sidr Y? 

[U A^uswER: (1) 12 or 28-16 

(2) incorrect rj^ponit 



83. 



□ 



How fn«nv iquari f««^of floor i^Kt art thtr« in the offie«7 

ANSWER: (1) 120 or if Student correctly multipl ies 
his answers to 81 and 82 

(2) incorrect response 
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1 

2 



1 
2 



1 
2 



63% 
31% 



65% 
12% 



56% 
38% 



81% 
15% 



23% 

■ 4 

61%' 



35% 



52% 



EMC 



1.56 
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ASIC 
-J- 



Rtipontt 13 17 



89. 



Pr«tend that your nim« is Dale Rob«rt» and you Jive at 1545 Lakf Streat in Narka, 
Kanm. The zip coda for Narka, Kansas, is 6696Q. You hava written a tottei^ to John 
Way. lives at 345 Moose Street, Nome, Alaska. Thf:iip code for Nome, Al^ka, 
is 99762. Addreu the envelope belovv. Make sure you write down evarything that 
should go A the envelope. 




89a Return Name- 

(1) Correct response 

(2) Incorrect^ response 

89b Return Street 

(1) Correct response 

(2) Incorrect response , 

89c Return City. State, and Zip Code 

(1) Correct response, 

(2) Incorrect response 
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91% 
3% 



91% 
3% 



96% 
0% 



96% 
0% 



91%^ .96% 
3%' 0% 




J. 
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ft 



M. Pnttnd **t your ntm«4 Oal* Robara wet you llvt at 194B Uka Smat in Narka, 
Kanut. Thaz)peodaforNlrky|;an«aB.ii«fl8eO. YouhavawirittanAlaRarteJolin 
Way. Ha liva* at 343 Moon flKt. Noflw. Alaaha. Th« lip eodt (or Noma. Alaska, 
ia 99782. Addraat tha baiow. Maka wro you writa down avarvthira that 

tfiould go on. tha anvalooa. . 




89d Na,nie 



(1) .Correct response 

(2) I ncorrect response ■ 

89e Street , 

(1) Correct response 
(;2) Incorrect response 

89f City, State,sand Zfp Code 

(T>CoTTect response 

(2) Incorrect response 
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2% 



94% 

3% 



{ 



94% 97%' 



1% 



97% 
1% 



94% I 97% • 
3% ! IX 
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Prvttnd that your o«m« \$ O^in Robtm and you livo •r1$48 Uko Scrttt in N$rk%. 
Kantal Tho zip eodo for Norks. Kmm. ii 66960. You hM whntn • lottsr to John 
W«v. Ho livM it 345 Moo« Strttt. Nomo. Ataika. Tho zip codt for Nomo, Alaiks. 
ii 99762. Addrm tho onvoiopo Mow. MsKo sum you write down •vory^hing that 
shouid 00 on tho fnvtiopa 




89g Entire Envelope 

(1) One component correct 

iz) .Tw) components correct 

(3) three components correct 

(4) Four components correct 

(5) Five components correct 

(6) Six components correct 







0% 


0% 


1% 


0% 


3% 


255 


1« 


0% 


1% 


1% 


89% 


f95% 



159 



OBJECTIVE. 4: BASIC SKILL 



Btlow it • list tablt. 





SIZE TABLE FOR SOCKS 


8ho« 


Sock 
Sizt 


Shot 
. Sizt 


Sock 
Sizt 








11 . 


IVh 


10 


10-10H 


*- 
11% 




, 1 




V2 - 



90, According to'^tht W)at ii'zt tockj should you buy if you wttr i^zi 10 ihott? 



iO 7 

2 O 7% 

3 O 10 

4 O 10% 
s O 11 

0 • 11% 



92. You wint to call Mr. Jonts on tht ttltphont. You look In tht tfltphont book for his 
numbtr. You would find it bttwttn which ntmti? 

1 O J^too and ^Jacobs 
a O ^Mobs and Jamts 
3 O JAmtfl ind Johnson 
« # Johnaon and Judaon 
5 Q Judu>n and Justus 
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ERLC 



1^0 



1 

2 
3 
4 
5 
6 



1 
2 
3 
4 
5 



1% 
3% 
Q% 
5% 
3% 
79% 



1% 
1% 
4% 
Z% 

i% 
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17. 



— _ ^ ^ 


1 
I 

! 






A fictory m«n«9tr hit just c«lltd a rrmx\riCo^!^^^^^^^ to dtcidt whtthtr ch«y can 
makf and dtlivtr 200 inflatal>lt boats of a ntw tvp« witiiin twowttks. W^icb ooa of 
|ht following lubjfcts would bf tht LEAST worth^hitt to diKuit at cha mttting^ 

■ ■ / ■ ■ . 

^) O whfthar tht fictory Ha* t nough matarials on hand for 200 boats 

3 O of mattrial to ba ustd 
y 4 0 whathtr ovtrtima will bt rtquirad to nnaat ttit two*w#ak diadtin« 






.* » ' 

)» 


1 

• 2 
3 
4 


10% 
53% 

9% 
14% 


7% 
69% 

5% 
11% 


9 O • ^oTi't know. * 

• 


5 


10% 


6% 
















■ 




* 




• 










f ■ ■ ' . 








♦ 
















1 ■ • . ^ 






»■ 
1 
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OBJECI^^ 



) 



AJTITtfOES AND VALUES 




c — ' 

Don't fo vfi, 
- MaiT t \iilthjvf 
.murf 10 loi >ou, 

of liffii iQ ^f) 10 
rh« Kurt. . 


10 mmuiii 


Oh Tom. 1 
«anffr. I>u( i 
;o luw. 




r 1 



/ ^ 

Oh. ii) rifhi. fMi 1 
think you'rt Mint 
mUv. t tiiH hjvt 
mtfra ihinf^ to . 
i«U you. 


\S mtnutii 


Tom, 1 juii 
h««« 10 fo 1 
now. 


• 




'**iL \Ijrv. *ner* « 
(h« nrtua > j>kffU 




25. WhoM lault wu it that Miry did not buy th. bread forH«r mother that nignt? 
' O --'t vvaj Tom'i fault btcauM h» talktd too long, 

J,0 It WM no ont'j fault btcauM Mary didn't want ;o bt rudt anct leave Tom. 
^ 't/ww fom'i fault because he wouldn't let Mary leave, 
< # It vwa» Mary'j fault because she talked too long. 

5 Q I don't know. 
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1 

2 
3 
4 



10% 


7% 


37% 


32% 


19% 


16% 


30% 


42% 


.4% 


3% 




4 
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c 



13 17 



Bfiow tn four thingi a ptnon might do to improvt chtocti/or luccttt u t nurw m % hoipitai. 
fWt m thf firit circlf bMidt ttch on« that IS impoaant for tucctu. Fiii in tht lacond circia 
b«iidt tacli on« that IS NOT important. 







<• 




'0 


2 0 $4. 


* 


2 0 















irworK 



62. 



63. 



64 .> 
65 



Lynn, a young bookkMpvr. is progrtning toward htr carttr goaf a* an accountant. Wll in tha 
firrt circia betid* aaeh behavior that will IftraaM har chanctt for »ucct*«. Fill io-tfta »acond 
circia basida atch ona thai will havt littia affact on har luccaa*. / 



' 9 2 O 70. She it tnrolling in collaga mathamatics couriat. 

*0 71. Shaaxpraut* nawidan about Jiar-bookkaepingiob. 

' C 2 • • 72. She rtiaitaa deei»ion» without coniul'ting har bou. 

' • 2 O 7a Sh« is dapandaoie «nd enthusiastic about har job. 



70. 
71. 
72. 
73. 



1 i 

\ ■ ■ 



1 ' 
2 

1 
2 

1. 
'2 • 

1 
2 



1 

2 

1 

2 

1 
2 

1 
2 



72% 
26% 

84% 
14% 

9% 
89% 

51% 
46% 



81% 
18% 

88% 
11% 

6% 
92% 

57% 
41% 



77% 
21% 



90% 
9% 



63% I 73% 
35% 26% 



22% 
76% 

89% 
9% 



18% 
81% 

95% 
4% 
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. Suppow you art a factory wor ktr opcrtf ing a machine virhlch hat a ip«d4' lafaty tnWid 
«rt It You a/i raquif^ to put up tf>a aafaty ihiald whwvtr tht machina <i bting u*d 
•o^t hot piacft of matal vvhich coma off tht micKlnt cannot hit and burn othar 
wkffi. Ono day you art oparatlng tha fv^ehlna without puning up tha taftty ih^ld 
A pioco of hot mttal fltai through tho air and aavmfy bumi anochar wbrkar who wai 
in a placa whact ha waan't lupppaad to t>a. 

Aft ypu raipontib|# for tht inji>^ to tht ^ttr ptnon^ 

3 O » c'on't know. , • * . 



. Uittd batow aft vtrioua attitudta ihat ptoplt^imiflht Nm about working. .Somb of thttt 
attitudta might htfp ptopla gtt ahtad In tht^r jobs, and som« might noL' Hwti iich nattmant^ 
If you think tht artftudt would htfp tomtont bt luccttsful in his or htr job, fill in thtcircit 
in tht column htadtd IMPORTANT. If you don't think tht tttitudt ii importint for mcctn. 
fill in tht 6rclt in tht colucrtn htadtd NOT IMPORTANT 



107. Aiwtyi look for ways to improvt things. 



708. Katp your mouth shut and don't stir 
things up. 



1 09. Kttp latming how to do your job bttttr, 
1ia tlong wtll with tht othtr wdrktrs. 



1/1 1. Don't ttfl anyont about mistakn you 
Nawt madt, 

. * 

1 12« AJwtys do tht kind of work you can bt 
proud of. 



1 13. Oo only what you art tqld to do. 



3. . NOT 

IMPORTANT IMPORTANT 

it 20 107. 

. ■ ^« 108. 

• JQ " 109. 

" t lO 

• 110. 

'O 2t t 

. 111. 



aO 

Irf. 



113. 



1 
2 



1 
2 

1 
2 

1 
2 

1 
2 

1 
2 

1 
2 

- 1 - 
Z 



73% 


83% 


16% 


9% 


8% 





! 



90% 
5% 

46% 
49% 

92% 

m 

80% 
14% 

20% 
75% 

60% 
15% 

75% 
20% 




I 



93% 
4% 

41% 
56% 

95% 
2% 

91% 
6% 

15% 
82% 

90% 

60% 
36% 



^ ■ 



'A 



APPENDIX", B 




Copies of Student Questionnaire Instruments 
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l4V Vbu are: 



IS-YEAR-OfbS 




1 ^ male*^^ 

2 O fffmale'f 



2. What grade are you in? (Fill in ONE circle.) 



1 6th grade 

2 Q' 7th grade 

3 O 8th grade 

4 O 9th grade 
' .5 Q 10th grade 




iut sch<;|j^;^ 



in ONE circlfe^'^^ 



3. Which sentence below show$ how you' 

1 O ' really don't like school much at all* 

2 O IVlostly i don't like school, but there are som^ things about it t' like. 

3 O School is O.K., I gu6ss, but there are some tlpngs about it I don't like.^ 

H ^ ^ O Mo^ly I like school, but there are some thingi atoi^t it I ddn't like so muQh. 
lO I really like sihool a lot. 
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How often are you given the followjhg kinds of homework to do? (Fill in 'ONE circle for 



each kind.) 



armost 
every .day 



once or twice » 
a week 



once or twice 
a'.mgnth or . 
less often 



Drill work (for example) - 
practicing arithmetic problems 
or spelling words) 



Read irrg assigned material 
(for example, library books 
or textbooks) 



20 



20 



30 



3 0 



6. Wrltfrig on assigned topics (for 
example, essays, term papers, 
or book reports) , 

7. Work that requires you to 
think or act on your own {for 
example, doin^ a project or 
selecting a topic to /esearch 
or study) 



1% 



20 



20 



3 0 



3 0 



Have you ever t&lkWl seriously to any of the following people about your plans for the future- 

what you want to do, what training you need, etc.? (Fill in ONE circle for each person-) 

A ■ ' - *. . ^ • r 

W ' yes no 

8. Career or guidance counselor 1 O 2 Q 

9. .Parent . , / * 1 O 

10. Friend ^ O 2 Q 

11. Person who does a job of .interest to you 1 O ' 2 O 

12. Teacher - / ^ O * 2 Q 



" There are te&ts to help you decide on your career or job plans. These tests help you. 



fmd out such things as what you like to do best, what jobs you would rather have, or 
if you have mechanical, clerical, or other abilities. Did you ever take such a test? 
. (Fill in ONE circle.) . ' ■ \/ V , 

2 Q no i *♦ ' J 

3 O I <*on't know, = ^ V . * 

.. ; • - #...1 .. 



liri general, dfo you feel that field trips sponsored by your schoof (for example, visiting a 
museum/a college, a factory, a^farm) teacb ypu things that are..useful for you to know? 
(Fill in ONE circled •/ ' . 

1 O ves . ' > * ' * 

2 O no ' . * 

aO I have never gone on a field trip. - - - 



How useful do you feel your schooling has been in helping you to think about the t\^e 
of work you wojJtd like to do after you leave high school? (Fill in ONE circle.) 

1 0 rJbt very, useful ' . 

2 O somewhat useful 

3 O very useful ^ ' ^ ' - ^ 

4 O I don't know. 

How much do you feel your parents are involved in what you do in school (for 
example, visiting your teacher at school or asking you questions about your schoolwork 
or school activities)? (Fill in ONE circle.) 

1 O hardly at all 

2 O only a '"ttle . • 

3 O Quite a bit . • 

4 O a 'ot ' ^ 




Does yourtfathier or your mottwr work 6r/have ,a job? ' 
3 O • don't know. ^ ^ 



18. If your father or ybur mother has a job, do they do any work like this? ' 



1 o yes 

2 Q no 

3 O .1 don't. know. 



19. 



teacher;- professor; medical doctor; dentist; lawyer; 
scientist; counselor; minister or rabbi; nurse; medical 
technician; social worker; engineer; own-or manage a 
store, restaurant business, factory>,or farm ' . 



I 



After you finish your schooling, do you want to do a job like any of the ones listed in 
Qpestion 18? 



11 



i:0 yes.. 

2 O no 

3 O ' don't know. 



20. if your father or your mdther has a job, do they do any work like this? 



1 O yes 

2 O no 

*3 O I don't know. 



.salesperson for a company or stor^; seill r6af estate, 
insurance, or cars; secretary; clerk; baker; meat cutter; 
carpenter; electrician; mechanic; plumber; bricklayer; 
tailor; fire fighter; soldier; police officer; foreman 
ovpr other workers 

- ; . ■ • . — — — 



21. After you finish your schooling, do you want to doa job like arty of the ones listed in 
Question 20)^ 

1 O yes 

2 O no 

. 3 01 1 don't know. 
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,22. If your father or ybur 'mottier has a job, do tihey do any work like this? • 



M O yes 

2 O no 

3 O ' don^t know. 



factory Worker; bartier or beautician; bus driver; gas 
stattorr service* persori; cashier; deliver/^ work; streets 
department work; help others clean; janitor; doorman; 
farm worker v 



After you finish your schooling, do you want tq dc5 a jqb like any of the ones listed in 
Question 22? / , 

iO yes ' * . ■ ' 

2 O no * . • . 

■ 3 O ' don't know. . 



24. How sure are you about the kind of job you would like to have in the future? (Fifl in 
TONE circle.) ^ 

1 O riot very sure 
2O somewhat sure 
3 O very sure 



25. To what extent do your parents want you to go to school or college after you finish 
high school? (Fill in ONE circle.) 

^ . 1 O hardly at all " . 

2O only a little ,. 

3 O quite a bit^ 

;. 4O 3 lot • ' ' : - 



26. 



After you leave high school, what do yoq plan to do? (Filfi^ ONE circle.) 

1 O Qet a full-time job or enlist in the armed sen/Ices 

2 O get a full-time job and go to school night 

3 0 get additional special training (nursing school, technical school, business school • 

4 O attend a two-year'junior ;br "comnriunit^ . - ; . 

sO attend a regular four-year college or university 

eO I haven't decided. . . 



27. Have you ever done work for which you were responsible on a regular basis (for 
example, part-time or summer work or regular household chores)? 

' \0 yes 
. 2O no 





A. 



17-YEAR-OLDS 




I" 



^You are; 

1 O iT»3te 

2 O fernat^ 



What grade are you ih? (Fill in ONE^circleJ 

t O- 8th grade . 
2.0 Sthgrade 

3 O 10th grade ' 

4 O nth grade 

5 O 12th grade V 



Which sentence below shows how you feel al^out school? {Fill in ONE cil*QleO 

1 O I really don't like school mi^h at all. ^ 

2 O Mostly I don't like school, but there ^re some things about it I jjke. 

3 O School is O.K., I guess, but there are some things about it I dqn't like. 

4 O Mtostlyl like school, but there are some things about it Kdon't like so much. ^ 

5 O I really like school a lot. ^ V 



'IP, 



\ 1 

172 



How dftenj^re you given the foilowing kinds of homework to do? (Fill in ONE cir 
each kind.) ^ 



almost 
every day 



once or twice 
a week 



once or twice 
a rinonth or 
less often 



DrHI work (for example/ 
practicing arithmetic problems 
dr speirmg words) 



Reading assigned material 
(for example, library books 
or textbooks) 



2 O 
O- . 



m 



3 0-# 



30 



Writing on assigned topics (for 
example, essays, term pagers, 
or book repor^ts) 

Work that requires you to 
riiink or act on your own (for' 
example, doing a project or 
selecting sy^topic to research 
or study) 



\0 



■20 
.20 



3 0 



30 



Have you ever talked seriously to any of the following people about your plans for the future— 
what you want to do, what tr'alning you need, etc.? {Fill in ONE circle for each person.) p 



8. 



. yes .' no 

Cdfi^r or guidance counselor , ' ' 1O - ~^Qf 



,10. Friend ' ' . ' . ' *' ■ * ^ t'O ■ /(J ' 



9. Parent , ^ i Q fi, 2 Q ij 



11. Person who does a job of interest to you 



1© •.>o<. 



\2. Teacher : , iQ ' 2p 
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• , . . - There are tpsts to help you decided your career 6r job plans. These tests help yob 

, • find out suph things as what you like to do best> what jobs y^u would rather have, pr 
if^you have mechanical, clerical, or other abilities. Did you ever take such a test? 

■ - (Fill in ONE circle.) . 

, / 2jO* no . W , * 

^ . -J' ' 3 O ' don't know. / ■ 

/.. •■- . . . "^'.^ , ' ^ 

; ' * ^ • ■ ^ • ■ ■ 

■ ' .% 

\ ' - • 14. * In genefal,/do you feel that fiefd trips sponsored by your school (for example, visiting a 

\ museumrB coHege, a factory, a farm) teach youvthings that are useful for you to know? 

V (FiJMn ONE cirqle.) ^ 



1 O^yes ^ • ^ ' 

2 0^no J . ' • 

have never gone on a field trip. 



15. How useful do you feel your schooling has been in helpinjg you to fulfill your career or 
job objectives? (Fill in ONE circle.) . * , 

1 O not very useful ^ 

2 Q somewhat useful 
. S O very, useful 

1^ 4 O J don't knpw. 



16. •<;^ow much^o you feeh youp^parerits are involved in what you do in school (for 
V ^ example, ViSltVrig your teache/at school pr asking you questions about your schoolworJ< 
- ^ ^or school activities)? (Fill in ONE circle.). " 

1 O hardly at all ^ , . 

2 O ^"'y 3 little 

3 O quite a bit ( * ' 
- 4 O a lot ^ ^ 




t 



Does your father- or your*moth^ work or have a job? 



1 O yes 

2 O no 

f 3 O I don't know. 



If your father or youf mother has a job, do they do any work like this? 



1 O yes 

2 0 no 

3 O I don't. know. 



teacher; professor; medical dbctor;'' dentist; lawyer; 
scientist; counselor; minister or rabbi; nurse; medical 
technician; social worker; engmeer; own'or mana^a 
store/ restaurant, business^ factory, or farm 




After you finish your schooling, do you want to do,a job like any of the bnes listed in 
Question 18? A : 



1 O yes 

2 O no 

3 O I don't know. 



0 




If your father or your mother has a job, do they do any work tike this? 



1 O yes » • 

2 O no 

3 O I do^'t know. 



salesperson -for a company or store; sell real estate, 
insurance, or cars; secretary; clerk; baker; meat cutter; 
^ carpenter; electrician; mechanic; plumber; bricklayer; 
* tailor; fire fiflhter; soldier; po\ice officer; foreman 
over other w'kers 




I 



\ 



After yfiti finish your schooling, do yOu want to do a job like any of the ones listed in 
Question 20? 



1 O y« 

3 O ' don't know. 



(f yoof^ father or your mo|higr has a job, d6 they do any work jike this?-|^ \ 



1 0 

20 rio ^ 

isPQ I don't know. 



^Factpvy worker; barber or beautician; bus driver; gas 
station service person; cashrer; delivery work; streets 
department work; help others clean; janitor; doprman; 
farm worker 



After you finish your schpoling, do you want to^do a^job like any of the ones listed m 
Question 22?^ ^ ^ * < ^ L 

^ \j yes ^ ' 
2Q no V • % I . ^ 

r don't know. 



'How sure ^re you about the kind of job you would like to have in th6 future? (Fill in 
ONE' circle.)^ ^ . ^ , , 

1 Q not. very- sure 

2 O somewhat sure ' 

aO very sure - 1^ , " 4 






5- . ^ 

i76 . 



To what extent do ypur parents want you- to go to sdhoof or- college after you finish 
high school? (RH in ONE circle.) ' * 



^ •0 ')^nrd\y/ at all 

2 O only a little 

3 O Quite a bit 

4 O a 'ot 



i ■ 



After you leave high school, what do you plan to do? (Fill in ONE cfrde.) 

- • 

1 Q get a full-time job or enli$t in the armed services 

2 O 9et a full-time job and go to school^at njght 

3 O get additional special training (nursing school, technical school, business/school 

^ eta) . 

^ . -. ■■■■ . • ■ 

4 0 attend a t#o-year junior or community college . , 

s Q attendiHregular four-yfear 'college or university . ^ ^ _ ' " 

6 1 haven't decided. — ^ 



How many times in the last 12 months have you discussed career plans with a guidance 
counselor in your school? (Fill in ONE circle.)' 



2O once!^r twice . - \ - , \ ^ 

3O three times or more ' . ^ • . 

4 O I don't remember or there is no guidance counselor.' 



28. Done work fpr which you were responsible on a regular 
basis (for example,, part-time or summer work or regular 
household chores) 



Have you ever done any of the following? iFill in ONE circle for each Item.) 

' yes no 

' Q ' 2O 



29. 'Done vdfunteer work in a career area of possible interest 
to you 



.1 O 20 



30. Participated in a work-study, flexible campus, shared 
experience, or student internship program 



'•.0 



20 



31. Which of the following best describes the program or curriculum in which you are now 
enrolled? (Fill in ONE circle.) 

1 O general program 

2 Q vocational program ^ 

3 O college-bound prograrh 

4 O business (commercial) program 

5 O ' don't know. ^ , 



7 
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'ERIC 



Massachusetts Statewide Educational Assess'ment 1977-7S 
PRINCIPAL QUESTIONNAIRE . 



J* 



Dear Principal: . - . - V . . " 

Please answer the foliowiny questions relative to. the EIGHTH GRADE in your 
school.. Jhank you very .'^uch for your cooperation. 





1. Five objective*^ in CaiVeer' and Occupational Development (COD) are' lis^ 
•below ^/ Please of-de^' them in.: terms^of the- extent to which itjstrrucUem 
or gyifeanie is -givei- to- student? in th« grade Indicated above-. Ra^ a 
..'Vf"!' n^xt to:th^ ofc)je.ctiV(B which recfeives the most emphasis; aj^' .jiext 
;/t<a:^th6 obj'icti.ve least femphaSiz^d^ etc. Use ea'ch^ numlj^^^ 4, 

nnl v' once. ' "i • '. • - • . ' A , 



COD OBJECTIVE 




A.' know'l edge' of t^e characteristics (c-lassif icAtions , maj6r 
. • duties , natupe of tasks , and salary) of various careers 
' and occupation^ . ' - ^ 

knowledge of t*^^ abfli ties , training, and preparation 
repaired or .us^fuT for var^io^g careers and occupations 

know! edge and abi i ^ ty necessary ,to plan and imp! ertient . 
<^S-reer decisions . \ 

ap^ication. of b^sic . skill s (}iunlerical<,j^ommunicati'6n'r 
?in|, interpersf&nal) useful in seeking anff retaining / 
emp-ioyment ' • / 



B. 
E. 



personal attiti'fles anCJtlues 'eontrib^ to careef . 



.ORDER 



How satisfied are. you with th^ level of knowledge" o'r, skill* of students 
in the above grade relative to these objectives? Check the 'approcrriate 
box. , 



OBJECTIVE 



S'ATISFACTION LEVEL 



Sa^ed Sati^ied. Dissartismd. 



Very 




A. knowledge of •the 
. ^ characteristics 
. ' - ( c1 as s i f i cations, 
major duties, • 
nature of tasks , 
and salary) of 
various careers 
and obcupations 

knowledge' of, the 
ajlrtlTties, 
aining, and 
reparation^ 
r^uired or useful 
for various 
careers and 
octupatfons 

C. knowledge and • 
ability necessary 
to plan and 
Implement career 
decisions' 

D; application of 

r"' basic skills 
Cnufnerical , 
'.corranunication, 
and .-interpersonal) 
useful in seeking 
and: retaihingf -/ 
employment * \ 

E. personal attitudes 

- and values . 

: cpntribu:t1n9*to 

. career success 



1 

□ 



1 

□ 



1 



2, 



2 

□ 



2 

□ 



3 

□ 



□ 



a - ■ a'. 



-3 

n 

3 

□ 



V 



□ 



4 

□ 



.4 

□ 



4 

□ 
4 



Indicate the TWO major ways in which the program in career anjd . 
occupational development in your school could be improved for the — 
grade above. (Check, two:) '- ' * - • 

1 - / more guidance\and/^r c$ireer counsel ing personnel > ; . 

2 \ more inservlce training for guidance personnel regarding career 

arid occupational education . . , , 

3 more inservice training for teachers regarding career and 

occupational educati-on . ' * 

4 mijre career and occupational education classes 

5 more infusion of career and occupational education concepts 

into curricula of other courses (e.g., mathematics.) ♦ 

6 \ better career and occupational education instructional 

,v materials ♦ ^ 

f 

7 ^ more innoval|^^ career and occupational education learning 

experienflgplW^ students {e.g., career day, shadowing, mock 
interviews; 

8 other; please' specify: ^ ^ •" 

9 none of the above 



Do you believe that all students must meet some specified miriimym 
standar^^^ achievement in reading, writing, and mathematics as one 
requirement for the a^warding ^if the high schbql diploma? 

' •'■ ■ . • ' ■ ■ " 

2 ' no 



3 Tm not sure. 



Which of the. foil owing do you beHeyfe $houTd be responsible for setting 
minimal competency standards to be used>as a "basis for the -awarcfing or 
denial of the high school diploma? (Check one. ) 

1 local" education agencies 

2 State Board of Education 

3 Legislature , ' ' . , 

^ both local educatipn agencies and the State Board of Education 

5 'other; please specify; . ■ <>' 

6 none of the above 



6. Is your school an ESEA Title I school? 

I'fi yes - . ^ 

"2 no 



* 

7. How vyould you rate parental . support of vour school's policies and 
. procedures?. Circle one. . 

Excellent (5ood Average Fair-^ Poor 

. • f <— - 5 ■ 



1 • '2 • 



How .would ydu rate the Attitudes of the majdrity of your students 
toward schopl. and learning? ^ircle one. ./ 

Excellent Good Average. Fair Poor 



please look at page 2 of -your School Register. From the Quarterly 
Reports section, please prov'ide us with the percentage of attendance 
for the first and second quarters of this year for grade eight (total 
of all classes). Tlote: Principals of Boston ischools need not complete 
this question. Attendance information will be obtained the 
Department of Management Information. . r 

First Quarter . ( Second Quarter > 




.Massachusetts Statewide Educational Assessmlnt 1977-78 

^ PRINCIPAL Questionnaire 



Dear Principal : 



Please answer the following questions relative to the ELEVENTH GRADE in 
your school. Thank you very ^fiipi for your cooperation. 



PLEASE RETURN NO LATER THAN MARCH 24, 1978 



1. Five objectives in Career and Occupational Development "(COD)^are listed 
below. Please order them in terms of the extent to which instruction 
or guidance is given to students in the grade indicated a^ve. Put a 
"i" next to the objective which receives the most emphasilf a "5" next 
to the objective least emphasized, .etc. Use each number (1, 2, 3, 4, 
5) only once. ^ > . . , 



, V : - COD OBJECTIVE ' ' ORDER' 

'A. knowledge of the characteristics (classiffcations, majQ<» , 
duties, nature of tasks, and salary.) of various career? 
and occupations 

* 'B. knowledge of the abilities, training, and preparation 
required or useful for varfous careers and occupations 

C^' knowledge "and ability necessary to plan and impTelfent' 
career decisions 

^ [d, application of basic skills Cnumerical , cortmuni cation, ' 
and interpersonal ) useful in seeking" and retaining 
employment • . . 

E. pers.onal attitudes and values eonlributing to career 
• . success.. ■ •• , . .. '• 



How satisfied are you with the l€vel of knowledge or skill of students 
in the above grade relati^ to these objectives? Chetk the appropria.te 
box 



A. 



C. 



D. 



OBJECT If E 




Very 
SatHfi 



knowledge of the 
characteristics 
(classifications^ 
major duties, 
nature of tasks ^ 
and salary) of 
' various careers 
and occupaHlDns 

knowledge of the 
abilities, 
training', and 
preparation 
required or useful ' 
for vaopious * 
career^ and 
occupations 

knowledge and 
ability necessary 
to plan and 
impler^ent career 
decisions 

appli;:ation of 
basic skills 
(nunierical , ^ 
coimiuni cation, 
and 'interpersonal ) 
useful iJTi seeking 
and retaining • 
employment 



E. personal attitudes 
and values 
cbntrlbuting to 
career succiess - 



^i^d 1^ 



SATISPACTION LEVEL 
Satisfied Dissati^fi^ 



1 

□ 



1 

□ 



1 

□ 



1 

□ 
□ 



2 

□ 



2 

□ 



2 

* □ 



□ 



□ 



If c 




3 

□ 



•3 
□ 



Very 
Dissatisfied 



3 

□ 
3 



4 

□ 



4 

□ 



4 

□ 



4 

4- 
□ 



. IndiQ^te tl)e minajor/ways •In.wWch the prosfram in career and ■ 
bccu^tipnal flevelopment in yoLl[W school could be improved for the 
^rad? above. (Check two.) 




more gul dance and/5f^re^r\coynsel i ng per^jjjane] 

^*li3Sfr*l" J'jyj'^Jf .'^;^ot.j^**^"*^* P^"^^ career 



and occjjjp^^nal<jmjdrt1on^ 



inser 
occup^tiona 



6 
7 

8 
9 



larWu^ 



^ raining for teachers regarding career and 
ucation * • ' 



more career and occupational edilcation classes 

more infusion of careerJRd occupational education concepts 
in|o curricula of ottier ^courses (e^g., mathematics) 1 

better career and occupational education -instructional 
materials • 

more innovative career and occupational education learning 
experiences for students (e.g.; car^er'day, shadowing, mock 
interviews) 



other; please specify: 
none of the above 



Do you believe that aVl students must .meet some specified minimum 
standard; of achievement in reading., writing, and mathematics as one 
requirement for the awarding of the high school .diploma? 



1 
2 



yes 

no " 
I'm not sure. 




Which- of the foMowiQg 'do you T5ftlleve should* be responsible for ^tting 
!T)in;1maVcompfe^ency standards tpbe ased^as basis' for the awarding or 
defllal of the high school diplofrta? v^t^^hftdc^ 

1 local education agencies 

2 State Board, of Edu(;^t;ton 

3 Legislature 

'4 both local ecfu'cation agenc/es^and the Statei Board of Edueation < 

5 other; please specify: ^ ^ ^ 

6 . none of the above « 

1s-'your school a'n ESEA Titl<( I school? 

1 ; yes. ' ^ ■ . " 

2 " no / 

* ■ . - 

How would you rate parental support of your school's policies ancl 
procedures? Circle one. 

Excellent Good . Average Fair Poor 

1^2 . 3 4 ' .5 

■ . • • ■ - * : f 

Hpw would you rate the attitudes of the majority of your students 
toward sdiool and learnfns? Circle one. 

/ ■ c-*^^ v... ■. - ■ . • 

Excellent Good Average Fair , Poor 



1 
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4 . ■ ^ 



9. Please look at page 2 o*f your School Register. From the Quarterly 
Reports section, please provide us with the percentage of attendance 
fo»^ the first and second quarters ofvthls year for grade 11 (total of 
all classes). Npte-: Principals of Boston schooTs need not complete 

X this question. Attendance Information will be obtained from the 

\ DepartmeRt 0^, Management information. 

"■■•■c. . • ' ^'^ ^ ^ ^^^^ 

First Quarter ^ . > ^ ; Second Quarter ' 



V 



J 



To what extent are vocational andjitjilipational educatioh programs 
(industrial arts, distributive education, health occupations, etc.) 
available to all. students in your school whtf wish to take them? 



1 _L_ generally available 

.2 somewhat available 

3 available to a minimum extent 

4 . hot available 



ERIC 



: 4 



ERLC 




..« 

0 



APPENDIX D. 



Identifi^ion of Regtorj and Kind of Community 
for Massachusetts School Di streets 



1^ 
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i 



Identification of Region* and Kind of Coimiunity** 
. for Massachusetts School Districts f 



Re9 



Ablngton 
Acton 4 
kushriflt 

Anertury 
Amherst Union ?6 

Andov^r 
Arlington 

Aihburnham Union 56 
i^shfleld Union 65 
Ash I ami 
Alhol 

Altleboro 
Auburn 
Avon { 
Ayer / 
BirniUble 
Barre Union 61 



Bedford i 

Bclct\)!rtown 5 

Bell'inghaif) ^ 

Beiinon^ I 

lerkUy Union ]7 '4 

Bert (n Union 60 6 

Bernards ton Union 18 
Beverly 

Billerica I 

Blacliiuone Unio(i^44 6 

Bolton Union. M 't 6 

Bo5tdn * • I I 



on 



:oc 



oca*l 



ubiic Schools 



•School Syitem RKjIlon KOC School Syjtwi < 



i 



Bourne Union 10 
BOxl}orf)U*|h Union 4? 
Boxford Union S8 
Boy Is ton Union 60 
Braintrre 
Brewster Union 5^ 

Bri4r]ewater* 
Brifflfiald Union 61 
Brockton 

Brookfield Union 61 



BrookMne 
Burl inn ton 



Carttbridqi' 
Can tun 
Carlisle 
Carver Union 62 
Chatham 
Chelmsford 

Chelse« I 

CliesCerfleid Union -06 
Chlcopee 

C^ilm4rk|nlon 19 
Cljrksbii* Union ^13 



1 

I 
2 
6 
I 

4 

< 

4 
I 



Clinton 



Cnhasset 
Concord 
Conway Union 38^ . 
Qanvers 
Dartmouth 
OedhaiK ' 



* Region OefWitlonst ) ■ Boston R^ilon; 2 « Northeast Region; -3 « 
PI ttsfleldi Region; 4 > Southeast Region; 5 ' Springfield Region; 
6 • Central Mass. Regjon * 

woe Definitions:. I « Big city; I * Industrial subur^. ] « Residential 



suburb; 4 • Other » 



V 

ERLC 



Oeerfield Union 30 
Dennis IJnion II 
Oighton Union 11 
Douglas 

Dover Union 50 
Drjcut 

Dunstable Union 46 
. OuKbur^ 
^ East Bridgewater 

ElsLBrookficId Union 

Easthait) Unlcfh 64 

Casthampton* 

* East Lonrqmeadow 
Easton 

Edqartown Union* If 
Erving Union 23 
Essex Unio^ 48 
Eve^ett 

Fairhayen 
Fall Rivavf 
Falmouth 
Fitchburg 
Florida Union 43 
^Fo^^borgu^lt . 

Frimingtiam ' * • / 
Franklin 

.Fr^OWn Union ]i 
Cardner 
Georgetown 
Gill Union 18^ ; 

Gloucester 
Coshen Union 66 
GosnDid UntOn 37 
Grafton 
Granby 

Granville Union 39 
u— ^ 



.1 



1 



School Systtin 

Greenfield 
GrotOn tJnion 46 
Groveland Union '53 
lladley 

liali fax IJnion 11 
Hamilton Union 

Hjftipd^n 

lldhcock Union 69 

llanov^ 

Hanson 

Hardwirk Unioh 61 
llarvarri 

Harwich 
Hatfiel^d 
Haverhill 
MInghatn 
Ho I brook 

llolden Union 64 . 



Region KOC 



Holland Union 61 
Hollfston 
Ho) yoke 
Hopeddle * 

Hopkinton , 
^ubbardston Union 63 ;* 

Hudson 

Hull 

Ipiwich 

tCingston Union 31 
lakeville Union . 34 
Lancaster 

lanesborough Union 69 
Lawrence 
Lee Union^ 29 
Leicester, , 
Lenox 

leomVnster 



191 



I 



♦ * 



School SyttiHfl R«())on/.,)(|^C 



ImriKt Union ?8 
Ifxinyton 

yden Union 1(1 
slfiiKoln . 
UitltUn 
Lonqmeadow 



KrnW 
Ludlow 
Lunenbur) 
lynn 

lynnflelti 
Nildfn 



Manchester Union 48 
Minefield 
Harblef^edd 
Hirlon Union 5S 
Narlboroutjh 
WUfihfteld 

Mdshpee Union *I0' 

Hattdpolsett Union S5 

Hayn4rd 

HerlNeld 

M^dford 

Medw4y > 

Melrose 

Merrlmac Union S3 
Methiien 
Hiddleburouyh 
Hiddleton ' 



Hi I ford 

Mlllbury 
'Hillljs . 
Hlllvllle Union 41 
Hilton 

Horfroe Union 4) 
Monson 



2 
4 
2 

M 

4 

2 
6 



i 
6. 
I 

J 



3 
4 



^ 3 
4 
2 



SlhOijI S/$t,ifm Ret) ton 



HontJijin; ^ 

Nantucket 
N«tii> 
Heodhjin 
New Bedford 



J 

. 2 
4 
6 
I 

■ '4 ' 



N^w Brjlntree Union I J 6 

Hewbury Union 6IJ 2 

Mewbiirypnrt . I 

New U\m Union 28 6 

Newton | 

Norfolk 4 



Nuf Ih Adams 
North^iwpton 

North Andover 2 

North AttlebormKjlt 1 

Northl)orou«)h.Unlon ] 6 

Northhrldge " 6 

^ * » 

North Brookneld Union 6 

Northfleld Union 18 . ] 

North, ReJdimj 2 

Norton 4 

Norwell 4 

Norwood I 

Oak Blulfs Union 19 4 

Oakhani Union 6 J 6 

Oramje 6 

Orleans Union 54 ' «| 

Otis Unwn ?0 ] 

Oxford ' ^ 6 J 



Palter ^ ( 

P(Mtytrtfnion'64 

Peabody 

Pel ham Unison 26 
Pembroke Union J I 
Petershaw 



IC School System ilctjlon Mlf 



Phllllpston Union I 
PittsfHjM 
Plainvi He 
Plyinooth Union 62 
PlyniptOH Union 11 • 
Princeton Union 6'l 

Pfovlncetown Union' I 

Goinc/ 

Randolph 

Raynh<tiij 

Road I Ml) 

Rehoboth Union 1/ 
Revere 

Richmond Union u9 
Rochosler Union SS 
RoikLind 
Rock port 
Rowe llnion*65 

Row ley, Union f\l] 
Royals ion Union I 
Rutland Union 64 
Salem, 

Sal isbury Union 6H 
Sondisfield JJnion 31 



10 



Sandwich Union 
Saiigos 

Savoy Union 4] 

Scltudte 

Seekonk 

Sharon ^ 

Sliethorn Union 5i) 
Shirty Union 4? 
Shrewsbury 
Shutesbury Union 2\\ 
Sonlkrset 
Somervitle 



4 
2 

'J 
4 
4 



' School System 

Soutiidinpton Union^bb 
^uthborouijh UnTc' 
Kiithbridge 
^00 th Had ley 
SoiJthwIck UnMIn 39 
Spencer 

Sprin()field 
Stprllny Union 6-1 
Stoneham 
S tough ton 
Stow Union 4/ 
Sturbirdge Union 61 



Sudbury 

Sunderland Union 
Sutton 
Swamiiscott 
'Swansea 
fdunton 



FenipJ|»ton Union I 
fewksDury . 
risbury Union 19 
topsfleld Union 53 
huro Union 14 , 
fynqshorough 

Ty^inqhdffl Union 29 
Ufbridqe 
Wakefield 
Males Union 61 
Walpole ' 
Walt ham 

Hare 

Uareham > 

Warren Union 12 , 
Warwick Union 18 
Water town 
Wayland 

» • 



/ ■ 



School Svttsffl 


'Ret) ion 


KOC 


Uebster 


6 




Uellesley . 


1 


."3 


UellfUet union 54 


\ 




Uendell Union 28 


6 




Uenha<n Union 5/ 


I 


J 


Uestborough 
U«st Boylston 


6 


1 


' 6 


3 


Uest BridQ^vater 


4 


4 


Uest Brookfield i 






Union 12 


•6 


4 


Uestfield 


5 


■ i 


Uestford ' 


I 


3 


Uesthdfftp^on Union ^6 i 


3 


. 4 


Westminster Union 56] 


6 


4 


Uisl Newbury Union 50 


I 


4 


Ueston 


1 


3 


Uestport 


4 


4 



School Systeii) 



Region 
I 



Uest Springfield 5 

Uest lisbury Union 19 4 

Uestwood^ ' I 

Ueymouth i ^ 

Uhately Union 38 ^ ] 

Uhitnun 4 

Ullbrahaiti g 5 

gilliaitisburg Uinon 66 3 

Uillidinstown 3 

Wilmington , 1 

Uinchendon 6\ 

Winchester i 2 



^inthrop 
Woburn 
Worcester 
Wrenthan 
Yannoiith Union 



Academic Regiotial Schools 



Acton-Boxbofcugh 


2 


3 


Adams -Cheshire « 


] 


4 


Amherst-Pelham 


5 


3 


AshburnhaTm-Westminsler 


6 


4 


Alhol -Royal ston 


6 


4 


Berkshire Hills 


3 


4 


Berlln-Boylston 


6 


3, 


eiackstone^Hillville 


6. 


4 


Bridgewater-Raynhani 


4 , 


4 . 


Buckland^Shelburne 


] 


4 


Central Berkshire 


] 


3 


Concord-Carlisle 


I 


3 


Dennls^finnouth 


4 


4 


Dightjon'Rehoboth , 


4 


4 


Dover'^Sherborn . 


6' 


3 


Oudley-Charltpn 


6 


4; 


freetown-lakeville / 


4 


4 ' 


frontier ' 


3 


4 









Gateway 

GilNNontague 

Groton-Ounstable 

Hamilton^Uenham 

Hampden-Wilbrahain 

Hampshire 

Hawleinont 
King^Phllip,^ 
lincoln-Sudbury ^ 
Martha*s. Vineyard 
Hasconofliet 
I Mendon^Upton , 

Mount 'Greylock' 
Mohawk Trail 
Narragansett 
Nashoba 
NaAet 

New'Salem^nde'tl 



KOC 



J 
4 

'3 
3 
4 
3 

i 
3 



School System 'Region KOC 



Northboro-Southboro 
North Middlesex 
Old Rochester 
Pentucket 
tioneer Valley 
Plymouth-Carver 
Quabbin 

Ralph C. Mahar 



School Systetn Region KOt 



Silver Lake J 

Southern Berkshire , 3 

Spencer-jtast Brookfield 6 

TantasqJa 6 

Iriton 2 

Uacnusek 6 

WarreniW^sl Brookfield 6 

Whitman-Hanson 4 



VocationaMechnical Regional Schools 



Assabet ^Valley 6.1 

Blackstone )ta)leyvReg 6 .4 

Blue Hills Voc I 3 
Bristol-Plymouth Voc- 

Tech 4 4 

Cape Cod RegiVoc ^4 "4 

franklin County , } 4 

.Greater Fall Ri^r 4 I 

Greater Uwrence 2 ' I 

. Greater Lowell Voc^ech 2 4 

Gr;eater flew Bedford 

Voc-Tech jt ^ 4.1 



South Hiddjesex Vpc- 
1 fech Reg 

Minutemarr Voc^Ted 
* Montachusett Voc( 
Tech ,j 



1 • 



Northern Berkshire Voc ' 3 4 

Hashoba Valley Tech I .3 

Northeast Metro Voc • 2 • 3 

North Shore Reg Voc I J 

Old Colony J(eg Voc' 4 4 

PathfijpWer Voc-Tech 6 ^ 4 

Shawsheen^ Valley Voc-. 

lech^ ' ' I 

>utheastern 4 

South Shore Voc-Tech 4 

South Worcester * • ; J 

County Voc\ ,6 '4' 

Tri County Reg Voc- 
Tech 6 4 

Upper Cape Cod Voc- 
Tech 4 ' 4 

Whittier Voc 2 4 



I 
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National Evalaailon Systems, Inc. 



November 7, 1977 \ 

' ' ' . ■ ■■ ' ^ 

. . , ■ ■ . 

Dear Superintendent: 

Enclosed you (lliill find materials describing this year's Statewide 
Educational Assessment Pt"ogram and a detailad description of the 
Local Option component being introduced this. year. , •/ 

The enclosed mater*1als include the following: ' . 

• ■ " ' ■> 

• a lette*" from Acting Conmission^r, Michael Daly 

> ' 9 3 questlon-and-answer brochure > ^ .'^ 

• a flyer de»<:ribing the Local Optioij^ including^ copies 
•j of sample results reports (yellow) * 

• a district information form (blue) to be cor^Silfcte and ^ 
returned to NES not later than November 29 W7 

. . ■ • . -- ■ 

• a Local, Option participation form (pihk),to be completed 
ind returned to NES not later than^ NovepSber 29, 1977 

• a self-addressed postaga-paid envelope ' 

If you h^ve any questions regarding the La&sT Option, please call' - 
Dr. Dorit Sejwacz at (413) 549-28-J6. Th/nk you in ^advance for 
your attention and cooperation. % 





.1 



William Phillipiorth. Ph.D." , . . ' ' . \ 



President 'J 



J 

WPfi/hg 

Enclosures % 




TPe Commonwealth' ot Massachusetts 
'Department of Education 



31 ft 'Jm9% Avanut, Boston, Miisachusotts 02116 



FRTJM: 



/ RE! 



MEMORANDUM 



Superintendent of Schoojs 



Michael J. Daly// V /J, ' 
Acting Commissioner of Education 

Statewide Educational Assessment Program - 1977-78 
Local Option Testing 



During thel 1977^78 school year the Massachusetts Department of Eduction 
wl 1 1. *condu::t a Statewide' Educat ional Assessment Progra^m in two af^as: 
Career and Occupational Development. The assessment wi 1 1 
'orinatiort about the achievement of 9^and 17 year old Ma^s- 
tudents in Reading and that, of 13 and 17 year olds in^. 
Occupational Development. ' Test instruments , test admin- 

and student sampling wifl be modeled after. procedures used' 
-75 statewide^ssessment and those used by the National 
of Educational Progress, 



Reading an 
provide in 
achusetts 

Career and 
Istrations 
In the 197^ 

Assessment 



Tn additlor 
assessment 



the Department of €duQa-t>f on Is implementing a new 
jcomponent this year* In response to the requests of 
local persbinel that informat i<)n be* made ava i 1 able to them for use 
In local program assessment and planning, a local assessment option 
villi be provided, 

Each distr lit may elect to t>est^l age-eligible students or any 
portion of 1 hose students using thetest instruments developed fdr 
the statewi<e assessment program, MTesults of this testing will be 
reported directly to' the district and will not be submitted to the 
Department 'cf Education. Participation in the local option will 
be completely voluntary. Districts choosing to participate will 
contract directly with Mational Evaluation Systems, Inc. (NES) of 
Amherst, Massachusetts, the contract agency conducting the 1977-78 
assessment program. - * 



HJD:b 
End . 



Further details regarding procedures and costs of the local option 
are described in the enclosed materials 
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Massachusetts Statewide Educational Assessment- XQpy-'TS 

INFORMATION FLYER . ' 



During 1977-78 the Massachusetts Department of Education (MDE) will again 
conduct a statewide educational assessment. This year the assessment will 
focus on the following subject areas, each at^two different age levels: 

■ * 

• Reading (*9- and *17-year-olds) 

•Career and Occupational Development (*13- and *17-year-olds) 

'1 

Testing will occur during February and March, 197^. 

National Evaluation, Systems, Inc, (NES) of Amherst, Massachusetts, is under 
contract to MDE to conduct the assessment. NES'will/&ct as the I'lafson 
between Massachusetts school systems and MDE and will be responsible for . 
.the administration of major assessment activities, v 

The assessment will be performed in two steps: 

: • STEP 1: STATEWIDE TESTING. A Sample pf Students at each age level 
will be selected according to a- sophisticated sampling plan. Imple- 
mentation of the sampling plan will determine the Individual students 
to be tested and will ensiire the representation of students from all 
\ regions and communiti.es of all. kinds in the state of Massachusetts. 
From the performance of each sample, reliable estimates will be made 
- ' of the performance of all students in the age group. 

'I ' ■ - : ■ ■ • Y 

m^STEP 8: \LOCAL ASSESSMENT OPTION. Local district personnel ftiay 
elect to test, students in their own districts .at onef or both of 
the' two age levels and in orie^or both of the subject areas being 
assessed, usijfig the customized tests designed for St^ 1. Local 



The age definitions aVe as follows: ^ / . ^ 

9-year-olds — born during 1968 
.13-year-olds — born during 1964 

17-year-olds — born October I960, through Sep t^mbeir. 1961 



7) 
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testing will pccur simultaneously wUh statewide testing. Partici- 
pation In the local option will allow each district to compare the 
performance of its students In various regions of the state and In 
various kinds of conmunltles. In addition, on test items drawn frqi 
material of the National Assessment of Educational Progress, local 
districts will be able to make comparisons with results for the 
nation and the Northeast region of the country. This service must 
be funded by the district on a per-pupil basis. Each district 
electing to participate will contract directly with NES.. 



The Local Assessment Option 



Local districts may elect to test all of their students at either or both' 
Of the specified age levels and in either or both of the subject areas. If 
a district elects to test its students (at either age level or in either 
subject area), the following services will be provided by NES, For eacfh 
age level and each subject area: 



• training of test coordinators or administrators in test 
administration procedures at one of two regional workshops 

• delivery and pick-up of test booklets 

• editing and scoring .of tests and data analysis 

• complete^ results r^orts as described below 



Two copies of each results report produced by NES will be provided. The 
reports are listed below, and samples of each type are enclosed (yellow). 



FOR EACH CLASS: 

• a Student Objective Achievement Report (see Sample #1) 



• a Class Item Analysis Report (see Sample #2) 



• a Class Objective Summary Report (see Sample #3) 



• a Class Questionnaire Report (see Sample #4) 





-3- 



FOR EACH SCHOOL: 

• a School Item Analysis Report (see Sample #2) 

• a School Objective Summary .Report (set Sample #3) 

• a School Questionnaire Report {see Sample M) 

FOR THE DISTRICT: ^ • 

•a District Item Analysis Report (see Sample #2) 

• a District Objective Summary Report (see Sample §3) 

• a District Questionnaire Report (see Sample H) r 

; ■ ■ ' 

The cosfTTs $1.85 per studen;t in each subject area at each age'level 
(minitiftim: $75 per district). In addition, the following ADDniONAL 
' servicfes are available at the costs listed: 



1) assisltefice in the interpretation of results for one age level 
.in one subject area at a'REGIONAL workshop for one or more 
members of the school .district — 

$9. 00/ person *• , - 

2) conduct of-a workshop WITHfN a local school district in the 
.interpretation of the results in one si/Sject area — 

$200. 00/ person 

3) development and implementation of local benchmark procedures 
for each school district {comparison of results with local 
teacf>er expectations) — 

■• .$200.00/session 

4) a written report interpreting the district-wide averages in 
comparison to the statewide assessment results for one age 
level, in one subject area — 

$200.00/report 

Enclosed is a Local Option Participation Form (pink) wHich should be 
filled out to indicate whether ybur distriat plans to participate in 
the locdl assessment option. This form must be completed and returned 
to NES in the self-addressed posUge-paid envelope enclosed as soon as 
possible, but not later th^ November 29, 1977. Instructions for 
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completing the form are attached to the form. At present you will indicate 
only whether you wish to participate in the basic option. At a later time 
we will ask you to Indicate whether you wish'any of the ADDITIONAL services 
listed above. 

If any schools in your district have been randomly selected for participa- 
tion in the statewide phase of the assessment program, you will be notified 
shortly. However, this should present no problem. Detailed procedures 
have been developed and will be provided to districts participating in both 
the statewide assessment and the, local option. No student will be tested 
twice. Furthermore, the anonymity of individual students, schools, and 
districts selected for participation in the statewide assessment will be j 
maintained regardless of whether or not they are participating in the loca^ 
option. 1 

Also enclosed you will find a District Information Form (blue) which should 
be returned along with the Local Option Participation Form by November 29, 
1977. This form acknowledges youi/receipt of this mailing and provides NES 
with the names of district-level personnel who should receive future mail 
ings instead of, or in addition to, yourself. It also contains space for 
any special instructions or comments you may have regarding contact with 
your district. } 

If we can supply any further information, please call us at (413) 54^-284^ 
Thank you in advance for your attention and cooperation. '"Vy 
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STUD 



GRADE B 
CLASS - 8-2 



STUDENT OBJECTIVE NO. 
NAME NO. pF ITEMS 

ABBOT GARY 

BAKER JOAN ' 

BERRY DAVID ■ ' 

CANDY ALAN 

FOLEY BRIAN ' 



GORTH CAROL 
LYLE KATHY 
LYON SUSAN 
MASON LISA 
PHAUP SCOTT 
ROSE BRUCE 
SAKS JOoi 
TREME AMY 



/ 

XEBER SCOTT 



2U1 
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ETTS STATEWIDE EDUCATIONAL ASSESSMENT PROGRAM 
(SUBJECT AREA) 1977-78 

« 

NT Objective ACHiEVEMBii report by class • 

f DISTRICT - HEAR 

SCHOOL' - WELL 
STUDENTS TOOK THE TEST - FEB/MARCH 1978 



SAMPLE #1 



PER( 
3 4 ! 


:ENT of ITEMS 
S 6 7 6 

k 4 4 4 


ANSWERED CORRECTLY 
9 "ha. 11 12 13 
4^ 4 4 4 4 


14 15 
5 5 


% X \ 


( X 


1 

X X 


X X 


X 


X X 


X/ X 


X X \ 


', * 


X X 


X X 


X 


X X 


X X 


X X \ 


X 


X X 




X 


X X 


X X 


\ X x 


X 


X X 


I' 


X 


X X 


X X 


( X \ 


^x 


X x' 


X X 


X 


X X 


X X 


\ X « X 


X 


X X 


X X 


X 


X X 


X X 


( \% % 


X 


X X 


X X 


X 


X X 


X X 


( i X 


'x 


X X 


X X 


X 


X X 


X X 


( X X 


X 


X X 


X X 


X 


X. X 


X X 


X X 


X 


X X 


X X 


X 


X X 


X X 


% X 


X 


X X 


X' X 


X 


X X 


X X 


\ X 


:-X 

i 

X 


X X 


X X 


X 


X X 


X X 


X X 




X X 


X 


X X 


X X 


X X 

> 


X 


i: 


X X. 


X 


X X 


X X 



LAND PUBLIC SCHOOLS 



ALL ITEMS 
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GRADE 6 
CLASS - 8-2 i 
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NAS8ACHU8ETT5 STATCKIOE EDUCATIONAL ASSESSMENT PROGRAM ^'1^'*^^ 
(SUBJECT AREA) 1977-78 

CLASS HEM ANALYSIS REPORT / paGe"« I 

DISTRICT - HEARTLAND PUBLIC SCHOOLS 
SCHOOL - WELLS 

30 STUDENTS TOOK THE TEST - FEB/MARCH 1978 



QUESTION 
POSITION 



CORRECT 
ANSWER 



""PERCENT 
CORRECT 



DISTRIBUTION OF RESPONSES (X) 
NR 1 2 3 ^ 



OBJEfTIVE 1 (THE TEXT OF OBJECTIVES WILL BE PRINTED HERE) 



1 

6 
II 
16 

OBJECTIVE 

2 
7 

12 
17 



OBJECTIVE^ 3 

3 
8 

i3y 

18 



1 79 


0 79 <) 


0 


19 


3 ^ «12' 


6 2 A\ 


12 


36 


1 92 


0 92 3 


2 


2 


3 50 , 


2 15 15 


50 


16 


(THE TEXT OF OBJECTIVE 2 WILL 


BE PRINTED HERE) 






3 71 


0 6 6 


71 


11 


2 '^0 


0 15 80' 


2 


I 


2 27 


6 24 27 ' 


IB 


23 


3 32 


6 25 19 


32 


16 


(THE T&XT OF OBJECTIVE 3 WILL 


BE PRINTED'^HERE) 






3 66 


3 17 5 


66 


6 


3 82 


0 8 6 


62 


2 


4 70 


3 2 1^. 


7 


70' 



20.00 



42 



•I . . . 

r 

NOTEi DATA ARE PROVIDED FOR EACH OF THE OBJECTIVES. A SIMILAR REPORT IS PROVIDED FOR 
DISTRICT-WIDE AND SCHOOL-WIDE RESULTS. 
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^SAMPLEf3 



■ ^-^ GRADE 8 ' 

Si^ Clfes - 8-2 . ' 



^1 



2*: 
•3" 



■ 5 



. 7 



^'MASSACHU^TTS. STAT,E*LOE EDUCATIONAL ^ASSESSMENT' PROGRAM 
\'' : '■ ' (SUBJECT AREA) 1977-7Q 

CLASS, OBJECTIVE Sl|IMAR-Y REPORT 

' , ' ' -DISTRICT - HEARTLAND PypLIC SjHOOLS 
. ■ \' ■ * \ ■ J t** SCHOOL - WELLS \ 

24 STUPInYS TOOK THE .TEST -TEB/MARCH 1978. 

NUMBER AVG NUMBER AVG .PERCEflr 

OBJECtj^VE ' . 



.'(.THE TEXT OF OBJECTIVE 1 WJLL BE PRINTED HERE) 



) (TI^E. TEXT OF OBJE'C'TIVE 2 ,WILL BE PRINTED HERE) 



(THE TEXT OF OB'JECTIVE. 3 WILL BE PRINTED HERE) 
(THE TEXT OF OBJECTIVE 4 WILL BE PRINTED, hIrE) 



•#fHE im OF'OBJECTlvfs WILL BE PRINTED H^RE) 
(THE TEXT OF OBJECTIVE 6 WILL BE PRINTED 'HERE) 



(THE TEXt'oF ofejEGTIVE 7 WILL BE PRINTEdttERE) 



8 ' ,.(THE TEXT OF OBJECTIVE S^ILL BE PRINTId' HEReT 



Or ITEMS 


CORRECT 


A PK pi <K «•■ 

CORRECT 


4 


1.8 


.■ 44 


4 

r 

f 




57 • 

t 


i 


3.7 




,4 


' 3.6 


. ■ • 

90 


." " 4 


3.2 


80. 


4 


2.7- 


68 




■ 2.2 


' 54 








4 


■3.6/ ' 


; 90 ■ 

I 




V 





TOTAL TEST SCORES 



AVERAGE NUMBER CORRECT = 44.7 ^STANDARD DEVIATION =7.5 • AvIrAGE PERCENT CORRECT = 68 



NOTEi DATA ARE PROVIDED FOR EACH OF THE OBJECTIVES'. lH SIMILAR REPORT IS PROVIDED FOR SCHBOL-WIDE^ 
AND DISTRICT-WIDE. RESULTS. ■ * ■ ■ ' 
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GRADlf 8 
CLASS -.8-2' 



\ 
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MASSACHUSETTS STATEWIDE EDUCATIONAL \ASSfSSMENT PROGRAM SAMPLE #4 
(SUBJECT AREA)' 1977-78 . ._ 



- CLASS Q.UES'TipNNAIRE REPORT , ' . ; ' 

. ' ' ' ., "DISTRICT - HEARTLAND PUBLIC SCHOOLS 

. . . '.SCHOOL - WELLS * " ' ■ ■ * 
24, STUDENTS TOOK' THE .TEST VeB/M/^RCH 1978 . ' 



WHAT SEX 'ARE YOU? 



NUMBER OR PERCENT -OF 
' \sfuDEN^S\ STUDENTS 



L 



■ * 



n1 



if 



i. MALE 
.2. FEMALE 



16 



" 67 



CONSIDER THE COURSES YOU AR£ TAKI-Nq THIS YEAR, 
WOULD'yOii SAY ,Y00 AREt. 



1. IN t,he general program 


9 " 


' .37 


2. IN THE VOCATIONAL PROGRAM 


3 


13 


3. IN THE C0LLEGE.-BOUND PROGRAM 


10 * 


42 


%, IN SOME OTI^ER SPECIAL PROGRAM 
S.iDON^T'KNOW J 


~ 2 


8 


0 


0 



HOft M^NY TIMES IN THE LAST 12 MONTHS HAVE ^'pu 
DISCUSSED CAREER PI^ANS WITH. THE GUIDANCE COUNSELOR 
IN YOUR SCHOOL? 



'1. NONE ' . . ' 4 

2.'l0f!ltE OR TWICE " , 8 

sAtHREE TIMES OR MORf ' '8 

4. THERE IS NO GUIDANCE COUNSELOR ' 4 



17 
33 
33 
17 



NOTEi THE/JESTIONS FOR THE-iSTUDEt*T QUESTIONNAIRE HAVE NOT YET BEEN, SELECTED. THOSH GIVEN 
ABfllVE ARE EXAMPLES' OF THE TYPE OF QUESTIONS ASKED IN THE 1974-^5 MASSAC+1USETTS 
FATEWIOE EDUCATIONAL ASSESSMENT. A SIMILAR REPORT IS 'PROVIDED FOR SCHOOL-WIDE AND 
nSTRICT-WIDE RESULTS. 
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Massachusetts Statewifcle Educational Assessment 1977-7-8 
\ INSTRUCTIONS FOR COMPIETING THE .LOCAL OPTION " 



■pARTICIPA^ON FORM 



P^lease^heck the appropriate box to indicate whether or not ypur district 
will participate in the. local option. Whether or not you plan to partici- 
pate, complete the reverse side of the form, and mail the signed fornr back 
to National Evaluation Systems (NES). If you do plan to participate^ - 
please compTet-e the table on the.forrti as follo'ws: 



1. Number of Students to be Tested 



You may: choose to test students in your district in either one or both of 
the subject areas. In each subject area, you may choose to test students 
at either one or both of the 5ge levels listed on' the attached form. 

You will be charged $1.85/student for the total number of students that you 
list oh the at^tached form/. 

On each of the four lines, write youi: estimate of the^uiSber of students 
that will be tested. If you do not wish to test in a particular subject 
area at a particular age level, write "0" on that line. ■ 



2. Student Selection . 



For the statewide assessment, all age-el igible students Cregardless of what% 
grade they are in) have a chance of being selected to participate. In 
order to be able to make direct comparisons between your results and those 
of the statewide assessment»^we recommend that you also use the same proce- 
dures for s'electing students to be tested in your district. Check column 2 
beside any subject area/age level in which you are planning to use this 
procedure for^ selecting students to be tested. 

However, you may. decide for practical reasons to tist only age-eligible 
students with'in a particular gradfe; ' 



that is, 9-year-olds In grade 4 
13-year-olds in grade 8 
and/or 17-year-olds in grade 11. 



209 



Should you choose to do this, please be aware that comparisons between 
your results and those of the statewide assessment will not be as accu- 
Jl rate, since not all age-e>igible students in the statewide sample are in 
the above 1 isted grades, fheck column 3 beside iny subject area/age level 
in which you are planning to use this proceilure for selecting students to 
be tested. 




A third alternative for se]ectingr students to be tested is simply to choose 
to test only students in the .fourth and/or eighth and/or eleventh grade 
regardless of their ages. However, pJeise be advised that this procedure 
Is the^least meaningful of the/ three procedures terms of comparisons of 
loca»l results. with statewide results. Check column 4 beside any subject 
area/age level in which you are plahning to use this procedure for* select- 
ing students to be tested. »* 



3. Testing All or a Pprtiop of the Eligible Students 

Regardless of which procedure you choose for selecting students, you may 
test either all eligible students or some portion of the students. If your 
purpose is diagnostk, we recommend that you test all eligible students. 
If your purpose is to evaluate a particular program, you may wish to test 
only a sample of your .students. . 

Beside each subject area and age level 1n wh1ch*you wish to test, check- 
column 5. (if you will be testing all eligible students) or column 6 (if 
you will be testing only some portion of the eligible, students-). 

i ... ' ' , • . 

CALL DoklT SEJt/ACZ AT (413) 549-2846 IF YOU HAVE, QUESTIONS. 



FOR YOUR INFORMATION 



When we recelvi^ydur completed participation form, NES will contact you 

1) con 'irni your participation.' 

2) provide yoM with dejtai Is of the local testing program (e.g., 
exa|t testing dates) 

3) find out whether you wish to purchase any of the ADDITIONAL 
services 



Has«achuset^State1(le .Educational Assessment 1977-78 
. LOCAL. OPTION PARTICIPATION FORM 



1— - ■ ■ ■ ^ 
Return no j^ter ttian N6,veiiiber 29, 1977 



■Mill your school district participate in some part of the' local ' assessment program? ; , 

If YES, please complete the. table below. Read the attached directions Eefore completirtg the form. " ' 



Number of Students 
to beyles^ted . 
Subject Area/ $ 1.85/student 
Age Level $75.00' minimum. ,,■ 



\ READING 
9-year-olds 

17-year-olds 

[ ■ y 

■COD 

13-year-olds 
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17-year-olds 



■ PROCEDURE FOd STUDENT SELECTION " . 


ALL OR A' PORTION 
OF STUDENTS * . 


. . (2) ' , 

Age-Eligible 
Regardless ' 
. of Grade ■ 


.(3) 

Aje-Elijible 
llith1|i Gr^de 


"(4)' 
. Within Grade 
Regardless 
QfAge • 


(3) 

All, . 

. Students' 

.1' 


Portion of • 
Students 


h ■ 
















D 


□ 


i 


S 


h 


□ 1 


□ 




t 

d 


□ 


□ 


□ ■ 


□ 




□ 
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SEE OTHER SIDE 



Test materials should be sent to: 
Name: I 



District: 
Address: 



-A 



THIS DOCUMENT SSHVES AS A LEGALLY-BINDING PURCHASE ORDER. PLEASE BE SURE THAT 
IT IS SIGNED BY AN AUTHORIZED INDIVIDUAL. Billing will follow delivery of all 
services. . / . 



Signature: . • 

Name (please prjint or type): 
Title (please ^rint or type) 



To facilitate state effectiveness in planning future local assessrfieht options, 
it would be h^lpf^l if you would provide the following in;f^nTiation. This * 
information is \(OLUNTARY. The anonymity of those individuals' who choose to 
respond will be protected. All information will be presented on a statewide 
basis only. 

» 

If your district IS participating in tKe local option, please indicate why. 
Circle the number or numbers that aj>fJTy. f 



1. 
2. 
3. 
4. 



comparison of local as 
Qurriculum planning 
curriculum evaluation 
project evaluations 

5, • diagnosis of skill of individual students 

6. other: 



sment results with statewide results 



If your district is NOT participating in the local option, please indicate 
why. Circle the number or numbers that apply. 

f 

1. budget constraints . . 

2. short timeline for decision-making 

3. statewide testing duplicates existing local assessment testing 
program 

4. assessment tests are irrelevant to local programming efforts 

5. ~ insufficient information available to make decision (e.g., test? 

not available for preview) 

6. other: 



Return this completed form to: NATIONAL EVALUATION SYSTEMS, INC 

Post Office Box 226 
. > Amherst, Massachusetts 01002 



ERIC 
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Massachusetts Statewide Educational Assessment 1977-78 
DISTRICT INFORMATieN FORM 



RETURN NO l^TER THAN NOVEMBER 29, 1977. 



• Are you the person l^o whom future mailings should be sent? 

" □ yes □ no 

If NO, please list the name, title and address of the district-level pei:son, 
other than yourself, wiom you designate to handle matters related to the 
1977-78 assessment (i.e*, to serve as a liaison between NES and local school 
personnel). THIS PERSON WILL receive all future correspondence related to 

THE assessment. 'YOU PERSONALLY WILL RECEIVE NO FURTHER CORRESPONDENCE FROM 
NES. Please give the materials from this mailing to ly^e person lis'ted below. 

Name: \ ^ ^ 



Titles- 
Address: 



• If the above-named person is NOT the district testing coordinator, should 
copies of relevant mailings be sent to the testing coordinator as well? 

□ yes □ no 

If YES, please give the name, title and address of the testing coordinator 
below. ' V- 

Name : 

Title: • 

% ■ 

Address : • ^ . 



• Special Instructions ^or Comments: 



Er|c 21 4 
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onBl E^^aluaition Systems, Inc. 



« 



November 9, 1977 , * 



Dear Superintendent: ^ 

As you dre probably iiware by now, thr- f'.i'.Srichur.et.t . j-.-pii t.'.t-nt fi.f 
Education is cu.rrtntly iiiipleiiien Li rn; Lho \j/l-'iK ^r.-.-i.e/ide EduC:;tioria I f 
Assessment Program.. The subject jr.vj :.:i.;Q asst^s-.c-rj Lrt^i your are 
redding, and. career, and ocf upjtiofidl v. lunncnl:. A -.tatpwide sample • 
of approximately 2,2C0 ^-year-oldi Tjnd 2,1'00 1 7.-yedr-ol ds will be 
tested in reading, and a sample of appro, i;.;atf;ly 2,200 13-yoar-olds 
and 2,700 17-year-olds -wi 1 1 be test&d in Coveer and occupcitiona 1 
development. A ipore detailed description or the proc^ram was sent to 
you in an earl ier mai 1 ing, y 

The purpose of this mailing is to advi^.p vou of th^. schools in your 
district which have been randoiiP v svlc i'- j 't,o fu-rt i i i paie in the 
statewide phase' of the assessrpr-r.t. P ^'-.-.wa h'-.r.1n:; tnrse 5c;hoijls is ' 
enclosed. Also enclosed is a meniorandur; froiri the Coitnissioner of 
, Education urging your cooperation in the assessment activities. 

The principal of each school sele'cred to participate will receive a 
letter explaining' the testing program. Each principal .iVill be asked 
to forv/ar^a roster of all 9-, 13-, and/c;r 17-year-olds enrolled in 
his/her school, due in our office no later than Decerher 5, 1977, 
From these rosters we will selec t a sanplo of "students to be tested 
in each school. Anonymity for all studenis and schools is guiVunteed 
Approximately one hour will be requirea -lor each test, including the 
administration of a student questionnaire. The testing period will 
be January 31 through March 31, 1973. 

National Evaluation Systems (NES) is the contract agency responsible 
for implementing the statewide assesspier: in Massach.jsetts . We will 
be v/orking closely with all -school persor.nel involved in assessment " 
activities. 

If you have any questions or concerns =ibout the nrocir.;m"'UL aeneral 
or about your district in particular, please feel free to call us 
collect (413-549-2846). Thank you for your cooperation. 



Regards, 



Dor It Sejwacz, Ph.D^^ 
Pf^oject Manager 



DS/pk 
Enclosure 




The Commonwealth of Massachusetts 
Department of Education 



31 Sl JanM^vmua, Boston. MassKtiusotts 02116 



M E M 0 R A N-'T) 



TO: 
FROM: 

RE: 



Superintendent of Schools 

Michael J. Daly ^/^ Ay- 
Acting Commissiot^r of Education 

Statewi Educat ional Assessment Program 1 977-78 

' \ 

For the fourth consecutive year, the. Massachusetts Department of Education 
is conducting a statewide educational assessment program. This year 
the assessment will focus on the 'subject areas of Reading and Career 
and Occupational Development.' 

Procedures employed in the Assessment will be similar to those used 
in previous assessments as well as;' those used by the National Assess- 
ment of Educational Progress, Currently, with the help of teachers 
and curriculum specialists from across Massac|;iusetts, tests are being 
constructed to assess the competency of 9, 13 and ^^7 year old students 
\n the above areas. In addition, the sample for the 1977"78 assessment 
has been drawn. 

Your school district was randomly selected as part of this sample. 
fKs In earlier phases, of the program the results of the assessment 
wn 1 not be reported at the district, school or student level. If 
individual districts wish to obtain results for themselves on their 
ov^n age-eligible students, they may participate in the local option 
testing described in a previous mailing to you, 

T^e Department of Education has contracted with National Evaluation 
Sy;5tems, tnc^. (NES) to administer this year's tests. NES personnel 
will, over th0 next several months, be contacting schools drawn in the ' 
sample, selecting students to be tested, scheduling testing periods, 
and supervising test administration. Specifically, NES personnel will 
be contacting the school (s) in your district listed in the enclosed 
materials to begin arrangements for testing. ^ Further details des- 
cribing this year's assessment and. your district's participation are 
given in these materials. 
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Superintendent of Scho^s 



It Is my hope that the tretnendous amount of cooperation provided 
by the schools in Massacnusetts during the past three y^rs 
^wlll continue, and that the rnformatlon obta.Ined from the assess- 
ment will prove to be even more useful to all of us In Improving the 
education of all" students. May I again, therefore, solicit your 
help. y - » , 

Shou\d you have any questions, please feel free to contact either 
Dr. Allan S. Harttnah or Mr. Matthew Towle of the Bureau of 
Research and Assessment at 617/727-8^*97. 

Thank you. 



NJO:b 
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National Evaluation Systems, Inc. 



November 21, 1977 



D€ai;^PrJncipal 



As you are probably aware by now, the Massachusetts Department of 
Education is currently implementing the 1977-78 Statewide Educational 
Assessment Program. The subject areas being assessed this year are 
Reading, and Career and Occupational Development (COD). A Question* 
and*Answer Brochure describing the program in more detail is enclosed. 
Also enclosed is a menorandMm from Dr. Allan Hartman, Director of the 
Bureau of Research and Assessment in the Department of Education, 
urging yodr cooperation. 

National Evaluation Systems, Jhc* (NES) is the Contract agency respon- 
sible for the administration of major assessment activities. Since we 
will be working* together to ensure the success of this phase, we would 
like you to have a thorough understanding of the activities which will 
occur over^the next few months. The remainder of this letter contains 
a description of these activities and the responsibility that you can 
assume to expedite the testing. 

Through a random sampling process, your schodl has been selected to 
participate in this year's program, and your superintendent |)as already 
been notified. The program involves the testing , of three age levels: 
9-, 13-,' and 17-year-olds. The particular activities^ in your school 
will involve testing a aample of students at the following age level (s) 
during the following time periods: 

( ) 9-year-olds during the month of February- 

( ) ' 13-year-olds during the first two weeks of February 

t ) 17-year*olds during the month of March 



and 17-yeir- 



Nine- and 17-year-qlds will be -tested in Reading, and 13- 
olds will be tested in COD. 



Description of Activities 



During the testing periods listed above, a sample of approximately 2,200 
9-year-olds and 2,200 17-year-olds will be tested in Reading, and a sam- 
ple of approximately 2,200 13-year-olds and 2,700 17-year-alds.will be 
tested in COD. No 17-year-old will be tested in both subject areas. All 
students will be asked to complete a student demographic questionnaire. 




218 



-2- 



Approximately bne hour and 15 minutes will be required for each test. , 
Incli/ding the admin istratlon of a student questionnaire. This time 
does NOT include time re<^uired for assembling students and distributing 
testlng^matemis. Anonymity for all participatlhg students, schools, 
and districts is guaranteed. 

^J'/?®?*^'''^^^ ^" 9^°"PS 0^ 25. Because a sample of students 

win be drawn at random, rather than tested in intac^t classes, a special 
room must be set aside for test administration purposes in each school. \ 
The test ackmnistrator assigned to your school v^ill contact you by tele- 
phone during the^month of January to Schedule a time for testing. The 
testing periods fpr each age Tevel are listed above. It would be very 
helpful if you could in the interim consider the, activities in your - 
school during the applicable testing periods and prepare-to discuss with 
us tne testing times that would be most convenient for you. We will do 
everything in our power to be totally responsible for testing: one of 
our administrators will Arrive with all rrecessary materials and will 
conduct the tests. Following are your responsibilities relative to the 
testing. 



Your Responsibilities ; ' 

1. Send to us as soon as possible, but postmarked no later- than Decem- 
' iV a roster of all students enrolled in your school in 

the following age levels: 

( ) 9-year-olds— born during 1968 
( ) 13-year-olds— born during 1964 

( ). 17-year-olds— born durthg October, 1960 - September, 1961 

If more than one age level is indicated, please be surfe to submit a 
aeparate roster for each age level and label each roster clearly 
All students born in the perlod(s) shown above must be shown on your 



2. If you have been asked to submit a roster of 17-year-old students / 

^" ACADEMIC REGIONAL SCHOOL, yftu must indicate ^ 
which of the students are enrolled in vocational programs. On your 
roster, place a "V" beside the name of each studeSt Shorn ^ou re^Sn 
on your Federal Reporting Form, as being enrolled in a'vocationaT 
education program. 
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3. Note on your rt)ster any student who should NOT be tested based on 
the following NAEP guideline adopted by the Massachusetts Department 
of Education: 



Students who are non-Engltsh-speakIng or who are handicapped 
(physically, mentally, or emotionally) In such a way that they 
could not respond to the test should NOT be tested. 



Once your rosters have been drawn up, place an asteriek (*) beside 
the names of those studfents who, according to the |f)Ove guideline, 
Should not be tested. . 



Acti vlties in- Your School 



During' the 
dents from 
foil owing: 




few weeks, we will be using the rosters to §ample stu- 
school. From your school, we will be selecting the, 



r-olds requiring 



^ 17-year-olds requiring 
_^ 13-year-olds requiring 
_ 17-year-olds requiring 



separate test admlnistratlon(s) > 
in Reading 



_^ separate test administratlon(s) 
4^n Reading , V 

separate test admlnlstratlon(s) 
in COD ^ 



separate test admlnlstratlon(s) 
in>fOD / 



Therefore, we will be .conducting a total of : test adm1ni«trat1on{s) 

in your school. If the number of students required for any age level 
exceeds the number of students on your roster, all of the students on the 
roster (with the exception of those excluded by the guideline) will be 
tested. As soon as we receive the materials and complete the sampling 
process, we will return a list of the selected students to you. 
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Sunmar.y 



In sunuiary, we requiest that you forward in the enclosed self-addressed 
stamped envelope: ■ 

(1) the completed roster(s) for the Indicated age level (s) with - 
notations'for students who should Ire excluded and, if appli- 

^ cable, notations for students enrolled in vocational -education . 
programs 

(2) the cdmpleted reply form ack;nowledging your receipt*^of th4s 
'' letter . / ■ ^ 

Pleas^ feel free to call us*collect at NES (413-549-2846) if you have 
r!!l^^ {^^^^^o^%AU^ At the Department, the contact person is Mr. Matthew 
Towle (617-727-8497). Thank you in advance fbr your continuing attention 
„ana cooperation. 

t ■ . ^ ■ ■ _ _ ' 

Sfncerely, ' . 4 



Dor it Sejwacz, Ph.D. 
Project Manager 



DS/bg 

Enclosures 
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The Commonwealth ot Massachusetts 
Department of Education 



31 St. James Avenue, Boston, Massachusetts 02116 



MEMO R/A N D U M 



TO: Statewide Assessment Sample: Elementary and Secondary 

School Principals if) , ' 




FROM? Allan S. HartnrtanSry^ rector / 

■ Bureau of Research and Assessment 

RE- ' ' 1977-78 Statewide Educational Assessment Program Procedures 



Phase I M of the Massachusetts Statewide Educational Assessment Program 
has recently been completed. Results from this phase in the areas of : 
consumer education, science* ecology and school climate have been mailed, 
to all school di str icts^^houl d you want to knoW more about these studies 
please contact your nearest regional office. % 

In May, 1977, the^tate Board of Education selected two major learning 
areas for Phase IV of the Statewide Educational Assessment Program: 
Reading and Career and Occupational Development. ^ ^ 

With^jjgJ^e assistance of teachers and carr i cul um' special i sts from across s 
the Commonweal th we have been developing appropriate tests for these areas. 
. In preparat ion^'for administering these tests, we recently drew the sample ; • 
upon which this year's assessment will be based. ' , ' 

YouV school was randomly selected as part of this sample. Your superintendent 
has been notified of your school's selection in the assessment sample. As in 
earlier phases of the assessment, the test results will not be reported at 
the district, school or student , l.evef. • / 

We have contracted,with National Evaluation Systems, Inc. (NES) to administer 
the testing program. I n the next few weeks one of NES"i5 field administrators/ 
wM}^ Contact you to review the details of the assessment program and your 
participation.^ Enclosed is information describing this year assessment 
and your school 's Involvement Jn^ the; program. * ' 

The cooperation of sphopl principals has been and will continue to be vital to the 
assessment program. In turn^ I look forward. to making the assessment program 
even more meaningful to the wdrk of Massachusietts schools. May I , therefore, 
^sk for yourtcontrnued help? 



Thank you^. ' ^. * . . 

ASH:b . 

End- V?^'" ■ 



NatkHiB^ Eyaluaiion Systems, inc. 



December 9, 1977 



Dear^Edufiator*. 

I am writing ^^'^.^J'^l^V your district's participation status In the 
Local Assessme"^ "Ption of the Massachusetts Statewide Educational 
Assessment program 1977.78. 

Enclosed you wj^] ^Irid a yellow form ("Verification of Local Option \ 
Participation') <*escrib1ng your participation In the Local Option 
according to our records. Please caT^fully review the figures 
entered^ order to confirm our recQpds. 

If you find any errors, please let us know Immediately (not later 
than Itetjem6«r^», p77) by calling us at 413-549-2846. Since the 
tests must go Printer on December 19, we must have an 

accurate count ^'J /he number of te&t booklets needed at each age 
level in each subject area be1ng|tested. 

If you find the ^ "format ion on the enclosed yellow form accurate, 

no further action is necessary on your part at this point in time. \ 

In the near future we will contact you to inform you about testing 
procedures. Please caTl us at the above number if you have any 
immediate questions or problems. . : 



Thanic you for yo"r tine. 
Regards, 

Dorit Sejwacz. P'^-'^- 
Project Manager 



OS/gf 

Enclosure y 
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Nai^iif^ai Cwailuation SysiGmis, Inc^ 



petir JPrincipjl : ' . ' 

This letter ib intended to provide you with three iniportont pieces of 
infoniiation relative to the Mdsvucliuset ts Statewide tducdtional Assessment 
Progrdiii 1977-7ij. ^ / 

FIRST, we hdve^enclosed one or more lists ot students from your school who 
hdve been randomly selected to participate in testing activities. Each 
list of 25 or. fewer students represents of>e testing session. The subject 
area and aye level being tested, are Indicated at tlie top of each roster. 

SECOND, please note the following guideline for determining whether or 
not individual students are eligible for testing: 

b'tuJant.s^uho ui't. m>n-t>iijd iiih-by,j<tkirii uv uho avu.huruiiaa\>ped 
(phytiiLiullij/ iitcfUaLlij, oi' ,ciiii>Lio,tulLij) in tsuc-'h a Day thtit they 
aoulJ not rctii'ond Lc thd 'ttivL nhould NUT be tested. 

' - ' ^ 

This guideline is used by' National Assessment of Educational Progress and 
has been adopted by the Massachusetts Department of Education for this 
year's statewide assessiiient. Please examine your list(s) of selected 
students to insurfe eligibility. If there are stadents on your list(s) 
who, should not be tested according td the guideline above, please call 
us inwediately for repTacements . , 

THIRD, the test administrator" assigned to your school will contact you 
xluring January or earl^ February to schedule the testing session(s). 
Inclusive testing dates are listed below: 



All 9-year-olds will be test^ed during the period January 30 
through* February 28. 197fi. 

• All 13-year-6rl.ds will be tested during the -period January 30 
through February 14, 197U. . ' 

• A.1V 17-year-olds will be tested dljring the period March 1 
through March 31, 197a. ' 




lease consider rf^wv It ies scheduled irt your; school during the applicable 
tdsting perioas- You can facilitate* testing Coordination by suggesting 
tasting dates \and times which would be most convenient ¥or you. Your 
tjfcst administrator will be glad to answer any questions and to assist * 
ybu in prepariyg for test actiii ni strati on. . " ' 

Please feel free to call u| at (413) 256-0444 if you have any inwediate • 
concerns. Thank you for your attention and cooperation. 

Syncerely, 

^Oorit Sejwacz, Ph.D.^ 
Project Manager > 
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The Commonwealth of Massachusetts 
Department of Education . 



31 St imn Av«iu«. Boston. Mitsichusettt 02116 



MEMORANDUM 



TO: 
FROM: 
RE J 



Pmar^^^^*^"^ ^''^"^^^^*^ • ^ Statewide Educational' Assessment 



Program 

Allan S. Hartman, Director 
Bureau of Research and Assessment 

Enclosed Questionnaire 



Your schoo , as you know, is participating in this year's Statewide 
Educational Assessment; of Reading or Career and Occupational olJelopment 

?f 5S^«"rnt of the student sample in your bund?^^ 

Thl end 0? Sa'rch. ' '^""^ "^'^^ comJleLd before " 

To help make the statewide repotting of the results more meaninqful 
we are asking for your help. Specif ically. .we are asking p?in?iDas to 
complete .the enclosed questionnaire and return irin thS se^f"add?eIsS 
SySs.X'lTSEs").- '''' '''^ to Natio^allvalSaJjon 

Please feel free to consult with teachers and others in comoletina 

more tilan in any p^evious■ 
^f?ftI^?^c^^^^* '^""^ °^ the. instructional implicafciJns aXd nieds 
related, to student performance. The time you can give irfcomDlltina the 

2^^l^::2Sr^IpS;ll.'^ ^^^^ ^^^^'^ .ea^ingfJltirJKJS? 

in'^oJJ^SchSolTJir^nM T ^"'^"^^^ '^e^ng ccinducted 

in your scnool in both subject areas or at two age levels. Please take 

- .i??h>S^aiS ll^^ fS^^ questionnaires, since each shiu d be Spleted 
with regard, to a specific grade level ^ a particular subject area>. 

As always, your responses will not be reported +n any way that would ^ 
identify either you or your school. In short. anon^SIitfif gSa?anieed. 

Let me thank you beforehand for your cooperation. I, realize fillino in 
questionnaires is not exactly a briority. so your resJdSse wil belven 
more appreciated under the circi^stances. " 

Asi/tjfh 
Enclosure 

AC 
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NAEP Comparative Achievement Scores 
for the Nation and the Northeast 
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KEY FOR APPENDIX F 



tTht fallowing tables provide the following Information for NAEP Item 
scores for students In Massachusetts, the Nation, and the Northeast. 
ITEM' NO. gives the 1977-78 Massachusetts test Item number or th^ corres- 
ponding NAEP Item number. The P-VALUE is the estimated average percentage 
of test Items answered correctly by students In each population. SE Is 
the standard error of measurement of the p-value. DIFFERENCE Is the 
numerical difference between the p-vailue for Massachusetts and either the 

' national or Northeast p-value. A minus sign preceding the difference 
score- indicates Chat students in Massachusetts scored lower than those in*;, 
thejatidn oir^Northeast. An asterisk (*) preceding the difference score 
ihdfcates that it is statistically significant (by t-test at the .05 level 
of confidence).- ' 



mmum statewide educational assesshent 1977.78 

CAREER AND OC?UPATIOflAL OEVELOPHENT-13-yEAR.OLOS 
NATIONAL AND NORTHEAST COMPARISONS 



Missacliusetts Results 


~ ' 1 ■ ■ 

National Assessment of Educational Progress 


National Results 


Northeast Results 


Item No. P-Value SE 


P-Value SE Difference 


P-Value SE ^^md 




Objective 1 ^ • ., 



00005 
00006 
00007 



00009 
00010 



00011 
00012 
00013 



0002$ 



11.2 
71.2 
51.5 
56.2 
46.1 
82.4 



87.3 
85.7 
92.4 



^41,2 
48.1 



10 
1.3 
1.4 
1.2 
1.1 
.9 



1020116 


,3.3 


'•.5 


* 7,9 


102011C 


45:0 


1.5 


*26.2 


1020110 


50.8 


1.3 




102036A 


• 36.6 


1.5 


* 19.6 


102036D 


50.3 


1.4 


*-4.? 


102013A 


85,7 


.8 


*-3.3 



4.3 
53.0 
59.7 



54.3 



1.1 
3.1 
2.5 
3.1 
2.1 
1.8 



Objective 2 



* 6.9 
♦'18.2 
*-8.2 

♦ 12.2 
*-8.2 

•3.6 



. .8. 
• .9 
. .6 


1020130 
102013H 
1020131 


84.2 .9 
86.0 1.0 
93.7 .6 


* 3.1 
-.3 
-1.3 


85.9 i 
89.8 / 
94.0 


1.8 
1.6 

. .9 . 


1.4 

* -4a 

-1.6 




Objective 3 


, 1.9 
1.6 


104009 
104011 


58.9 1.5 
32.4 1.5 


M7.7 
*15.7 


63.4 
. 42.0 


3.0 
3.3 


*-22.2 
6.1 
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MASSACHUSETTS STATEWIDE EDUCATIONAL ASSESSMENT 19/7.78 
llAREER AND OCCUPATIONAL DEVELOPMENT- U-YEAR-OLDS 
/ NATIONAL AND NORTHEAST COMPARISONS 
(continued) 



Massachusetts Results 


National Assessment of Educational Progress * 


National Results 


Northeast Results 


Item No. P-Value SE 


Item No. P-Value SE' Difference 


P-Value SE Difference 


^ . Objective 4 > . ^ | 



00079 . 


90.8 


.8 


• 301005A 


94.6 




* -3.8 . 


96.5 


1.0 


♦.5.7 


00079 


74.9 


■ 1.3 


301005B 


. 80.3 


,:\ 


*-5.4 


83.4 


2.2 


♦-8.5 


00080 


21.2 


1.1 


301005C 


35.2 


1.6 > 


V *.14.0 


■40.1 


3.6 


M8.9 


.00083 


23.4 


1.4 


301010C 


26.8 


1.'6 


^ -3.4 


34.2 


3.8 


•♦■10.8 


0089A 


91.0 




302015P 


93.6 


.5 


♦-2.6 


92.5 


1.2 


-1.5 


0089B 


91.2 


.9 


30201SS 


92.3 


.6 ■ 


-1.1 ■ 


92.8 


1.2 


-1:6 


0089C 


91.4 


.9 


302015T 


92.2 






92.3 


1.3 


-.9 


0089D 


94.0 


.9 


302015N 


94.6 


.5 


-.6 


95.1 


1.0 


•1.1 


0089E 


94.1 ■ 


.8 


302015A 


93.2 , 


.5 ' 


' .9 


94.6 


1.0 


-.5 


0089F 


93.8 


.8 


302015C 


92.5 


.6 


1:3 


93.4 . 


1.2 


.4 


00090 


78.5 


1.-3 


301019 


66.6 . 


1.7 


,M1.9 


69.5. 


4.4 


♦ 9.0 


81/82 


48.6 


i;8 


301010 


53.2- , 


19 ,, 

1 1 1 


-4.6 


61.7 


. 3.2 

1 


♦-13. 1 



■0bJ«cttve 5 



00025 


•30.0 


1.3 


401003 ^ 


22.7 


i.o 


r 

♦ 7.3 


23.1 


■1.6 ♦ 6.9 


00091 


?3.3 


1.2 


401009A 


'71.7 


1 


,16 


71.9 ' 

4 


2.7 "1.4 
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CAREER AND pCCUPATIOWL DEVELOPNENT-U-yEAR-OLOS 
NATIONAL AND NORTHEAST COMPARISONS 



Massachusetts Results 

^ 1 


National Assessment of E(((|!catigaJ 


Jogress 


National Results 


<J: Northeast Results 


Item No. P-Va1iie SE 


Item No. P-Value SE Difference i 


P-Value. SE Oiffereup^' 


' ' T-l 


Objective 1 





00005 
00006 
00007 



26.3 
80.0 
67.9 



00009 
00010 



58.4 



1.6 
1.4 
1.3 
1.1 
1.3. 
.8 



102011B 
102011C 
102011D 
102036A 
10^0360 
102013A 



19.2 
67.5 
79.1 



69.6 
90.3' 



Objective 2 



00011 • 


91.8 


.8 


00012 


94.2 


.6 


00013 


95.7 


.5 


00036 


75.4 


13 


00037 


79.2 


. 1.2 


0(i038 


61.9 


1.3 



102013D 
102013H 
102013T 
102018A 
102018B 
102018C 



93.0 
94.6 
96.3 
64.3 
81.3 
59.2 



232 



ERIC 



1.5 


* 7.1 


20.7 


2.7 


5.6 


1.6 


M2.5 


■ 71.8 


3.6 


, * 8.2 


1.3 


*-11.2 


80.9 


3.2 


*-13.0 


.1.4 


* 14.0 


74.5 


3.2 


,6.4 


1.4 


*-11.2 


72.0 


2.5 


^-13.6 


.8 ■ 


*-3.4 


91.2 


1.8 


' * -4.3 



.6 


' -1.2 


91.5 


1.5 - 


.3 


.6 


-.4 


95.1 


1.2 


-.9 


.4 


-.f 


95 J 


1.1 


.2 


1.5 


* 11.1 


69.7 


2.'5 


* 5.7 


l.i 


•2.1 


82.8 


2.2 


-3.6 


1.4 


2.7 


.63.2 


3.0 


-1.3 





Objective 3 -1 




r 

'00004 '. 63.4 1.8 
00026 65.1 1.8 

4. 


014009^ 94.9 1.1 *.21.5 
. 104011 56.4 1.7 * a.7 


. 87.0 . 2.1 *.23.6 
58.9 ' 3.5 , 6.2 
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MASSACHUSfTTS STATEWIDE EDUCATIONAL ASSESSMENT 1977-78 
CAREER AND OCCUPATIONAL DEVELOPMENT- 17-YEAR-OLDS , 
NATIONAL AND NORTHEAST COMPARISONS 
' . (continued) 



Massachusetts Results 



'-^e^ 



SE 



jtional Assessment of Educational Programs 



NMional Results' 



Item No.' ■ P-Value SE Difference 



Objective 4 



mm 


94.3. 


.7 


301(lp5A 


.97.4 ' .4 


Q0079 


. 80.9 


1.2 


301005B 


89.0. ,.8 


00080 


34.2 


. 1.2 . 


30!005C ■ 


' 55.1* 1:4 


00083 


^' 35.3 


1.6 ^ 


30.101pC. 


49.2 ■ 1.5 


00090 . 


90,6 


1.3' 




,87.2 ■ 1-.3 


;ooo9i 


. m\ 


:1.8 


tolo 


75.9 ,1.1 


,810^2 


76.8 




ioioi 


8i0 , .v Ll" 



:*-3.1 

* -8.1 . 
*-20.9 

M3.9.. 

^ 3;4' ' 

•<-9.8 

* -7.2: 



- Northea^Hesul^^s 



P-Value S^. Difference 





: . — ^ — — t ■ — ' 

' • . , (Objective 5 , 7 . ^ 


00091 


82.9 1.2^ 


401009A - . 82.6 '" u" 








.1 



1 

i 



APPENDIX G ' 



Massachusetts Achievement Results by Reporting Groups 
on Total Test and Each Objective 
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The analysis by reportihg groups provides the following information for 
the total test and each objective. The P-VALUE is the estimated average 
percentage of test items ^nswered correctly by students in the population 
jor in the particular reporting group. SE OF P-VALUE is the standard, error 
of measurement for the p-value. GROUP EFFECT is the\ difference between 
the state average (all students) and that for the reporting group. An 
asterisk (*) means that the group effect (the difference) is significant 
at the 95% confidence level., SE OF EFFECT is the standard error of 
measurement of the group ef/ecti SAMPLE SILL is the actual nunfier of 
students in the reporting group who tod^tjietest. 
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P-VAHf P-VAlUf Ef«Ct 
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fO>6i n««n 0«I9 

GRADE OF THf 8TU0EHI 



OAJtCIIVE I. KNWUDGE (f CH|t)ACnRISTICS OF VAftlOOS CANFENS 
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10 79 30 AO AO 69 
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EFFECT SUE 
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0.32 
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mmWH • (MILL voliK 

01.43 0.43 0.99* 
S9.23 0.49 •1.200 
M.74 0.90 •0.70 



0.?4 
0*42 
0.74 
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760 
. 27B 



— -HOMIWIIH - HEAOINO ABSI(MfD MAIERIAL 

6i<5V 0.S9, 1.16* 0.47 430 

60.BO 0.A7 0.36 0.29 919 

69.66 0.47 •O.TS* 0.33 (f73 

— •HOMEBOIMl - NttlTING ON ASSIONEO TOPICS 

ft7*03 1.47 -.VOt 1.41 79 

B9*B9 5.76 •0.54 O.M &04 

AO.KA 0.3B 0.360 0«I9 1A4T 
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onjKim If KNrivLEDGG of cM/^RACief)i$iics or various carffrs 



' %f (IF CROUP 
P-VALIF P-VALUF EFFECI 



SF OF 5AMPLF 
rFFECT .5I2f 



^0*4 3 C*36 




2^3A 


ALL fJUOENTS 

■ ^ 1' ' 

DAILY 

WtEKLY 
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-^^•^MnMCt^ORK * NORK ON YOUR OWN 
W.^O l»4? *4.6b* 1*33 
&HJ7 0.7? •2.2M 0*59 
61,37 ^ 0i93l Oit9 


114 

40? 
1>09 


— TALKI-'D WHH CAREER OH 
i;9,V3 O16I *0.50 
60.79 0.36 Oi36l 


GUIDANCE COUNSELOR— 
0i49 590 
0*17 1669 


YES 
NO 


— TAlKtO y^IlH PARENT 
60*78 0.3A O.J4« 
ft0«60 n«7? -UA3^ 


0.11 
0*69 


1930 
29fl 


YES 
NU 


— 1LAKE0 I'MH FRIEND 
60,S7 0*30 O.M 
(0.;>3 0«fi6 Otto 


0*16 
0*55 


1734 
4fl7 


YIS 

NU 


-MALKFD NtlH PERSON IN 
b9«A3 C«b3 -^tM 
M.OI 0,36 , 0*56t 


INTERESTING JOB — - 
0.35 750 
0*?l 1456 
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NO 


"-TALKtU WITH TEACHhR 
S.9.35 0*7b -U09 
A0»7a 0*34 0*3b^ 


0*63^ 

tt)*l3^«T 




YES 
NO 



—-010 YOU FVEH UKE A CAREER TFST7 

61*75 0*59 1.314 0*45 542 

60*61 0*4|l 0*17 0,*29 I1B5 

5P*(«,> C.ea «1*634 0*46 506 
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0PJEC1IVE I, KNWLIOCt (P CHARACKRISTItS, Of VARIOUS. CAHt^ 



I • 



SI or sAMPu 

ffFFCI SUt 



CpOq )Me? 

P»73 2^7 

•:"J;^,^P°*-'?^ HELPS YOU THINK ABOUT WORK? 
6M3 f.70 .0,5( 0.6f 3Ae 

^^-^^ 

Vrt^W^MUtH ARf' yOUR PARFNU INVOLVED* 
bMj O.fr ^.M 0.77 • ?A7 

fto.eft o.no 0.4.1 o.4? m6 

()Q.P3 v.AT 0.16 Q«30 , 900 
fiV.Afl ' . 0»7| -0.95 0.5^ 03 



fU««lLY OCCUPATIONAL STATUS 

60;97 f.4V A. HA n 



^0f97 

&0.B7 
SB.i'l 



0.57 
1.07 

0. 92 

1. A3 



0.77 
-US7 
-2.2il 
-5.3M 



0.?A 
•0.4 H 
O.VV 
0»>0 
1.43 



MBIT 

, 15b 

7? 



«"0r you KANT 
f)O.i)0 Dt49 
(>0iOP (.147 



J08 LISTFD IN QUESTION I8?- 
' O.IS. ' 0.?f) 1160 
-N3S 0.41 65ft 
0*?l 0.!>5 AH 



■:r?2 ^^'^f''*' ^^J^*' ^QUESTION 207- 

S9.73 6.52 ^.0.70l 0.35 hnO 

JMI, 0.41 0.27 0.24 1 154 

60.BB .0.01 0#4b .0.70 401 

"--np WANT A JOB LISTF4) IN QUESTION 22?- 

5ft. 6 .0.A8 -4.27I 0.70 ' 246 

S*^0^ 0.17 1741 

5«*3B I.t2 . -2.054 . 0.90 24(j 
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I DONM KNOW 
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A LOT 
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ANALYSIS DY REHUMINC ONOUMS 

(no ij YMN oLus tmH(i \m 

ODJKIlve U KNO«L(DGF ^HAMCTCRlMICri \]f VARICVS CARF!N5 



P-VALU^: 
60 lA? 
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' nmtivi I. KNnniMt CH/^iAamliiiM of y/Miia^i cam 

wwmiiilo oNoui» ^ Mill 

ALL IIUDHMIH 



CiPHAIil (M 
0.19 



litis 
lOiOO 



0«A) 

0i77 
••?0 



fWNASlI ON 

6lt06 O.hl 



J»«6 



MS 

•0iA7 
Oill 
-0.A9 

OSJFCTIVt 
0.19 
•Di36 
^0.6A 
Oils 
-A.OS 



0*M 
0.73 
0.71 
Of 77 
0.64 



0.63 
OiSS 
OfTS 
OibS 
3.59 



m 

137 
75? 



391 
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44S 
API 
49 



fO.O? 
61*11 
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SSiAO 
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OiSS 
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-?*036 

-0*A6 



6o;ie 

' ^?i4| 

' 69*60 
60*26 
61 *0(/ 
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(•67 
0*96 
1*31 
0*76 
0*47 
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•o*o;> 
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60*06 
60*00 
60*09 
6I*S9 

60^30 



0*74 
0*62 
1*?^ 
0.9S 
l*?3 



0*3? 
0*43 
'6*34 
1*664 
0*13 



0*61 
0*54 
1.10 
0*59 
1*16 



604 

611 
327 
3?6 
213 



BY SlUOtMTS ON tlOJCCIIVE A* 
S9.ll >^0*i3 •1,324 0.62 ' 44 
6MS ■ 0*60 4)*4I 0.51 757 
t^iM 0*53 ^ •O.SO 0*34 IM2 
61*38 0«93b ' 0*95 0*96 |7| 

-"•ACHIIVfUfNT BY STUOfNIS ON OBJrcilYr B* 
^[•^ Itll 0*92 1*12 92 
Willi J 0.93 . *0.79 0.44, B27 
60*21 0*6t -0*17 0*42 991 
S9*89 1*39 •0*60 1*^ 124 
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NATIOKAL EVALUATION STSIEMSi INCt " CONlENT ANALYSIS OV SPPO«t](i«,WOUPr 
HASSACHUSETTS >IATtj»IO£^EOUCATinNAL ASSESSMFNf 13-YEAR OLDS SWING IWft- 



OBJECTIVF llKNnrLEOCF r* CHARACTFRISTKS OF VARIOUS CAREERS 



P-VALUE 
60.A3. 



SE OF, 
P-VALUE 



GRPUP 
EFFECT 



■SE.OF 
EFFECT 



SAMPLE- 
SIZE 

' 2230 



- — ACHItVEMtm BY'STyD^NtS ON OBJECTIVE 
57i*6 0.48 -2«97*, 0.59 50^ 
59r96 0»61 -0.47- 0.50 740 
60«4fl Cf51 0.05 0.35 1153 
U.O? li 0,69 . 1. 59* 0.75 96 

— -ACHIEVEMENT BY STU0ENT5 ON OBJECTIVE 0. — 
63.76 0.74 3.35* 0.61 23 
60.66 0.49 0.?2 ' 0.3? 1269 
59.71 0.67 •0/7? 0.56 6*2 
62.28 0.78 1.85* 0.83 75 

ACHlEVEMtNT BY STUDENTS ON OBJECTIVE E. — - 

60.21, ni8 -0.22 1.15 143 
60*'37 0.45 -0.06 0.2? 1319 
60.55^ 0.92 0. 12 0.77, 521 
58.*r 1.98: . -1.61 1.99 50 

— IS YOUR SChLoL an fSEA JITLt I SCHOOL? 



59.90 0.59 -0.54 0.4! 
6V.73 0.47 ' 0.30 0.37 

- — PARENTAL SUPPORT OF YOUR SCHOOL? 



.60.43 

'61.38, 

59.27 

59.88 

50.84 



0.64 
0.43 
0.65 
1.87 
0.70 



0.00 
0.954 
-M6 
-0.55 
-9.'594 



OiSl 
0.41 
0.74 
1.04 
0.T7 



965 
1073 



703 
649 

436 
66 
25 



ATTITUDF OP STUDENTS TOWARD, SCHOOL? ' 



60.44 
61.07 
58^77 , 
62.19'W 
0.0 



0.70 
0.48 
,0.76 
2.31 
0.0 



0.00 
0.63 
-1.664 
1.76 
-60.434 



0.64 
0.39 
0.63 
2.30 
0.35 



— -ATTEWANCE FIRST OUARTFR. 
58.14 1.01 -2.294 0.B5 



60.94 



0^36 



0.5! 



0.27 



-—ATTENDANCE FIRST QUARTER 
59.45 0.55 -0.984 {0.35 
61.35 0.44 0.9^4 0.36 



446 

996 
592 
50 
0 



408 
1604 



!061 

951' 



^ r 59.47 
/ 60.95 



ATTENDANCE SECOND QUART CR 
7 . 0.6T -0.964 . 0.47 
0.41 . 0.5? 0.34 



!1 



40^ 



ERIC 




REPORTING GROUP' 
ALL STUDENTS 



VERY SAT I 
SATISFIED 
DISSATI.5IF 
VERY DISSA 



VERY Satisfied 

SATISFIED 
DISSATIS'IFED 
VERY DISSAT'ISFIE 



VERY SATISFIED 
SATISFIED 
DISSATISIFED 
VERY DISSATISFIE 



YES 

NO , 



EXCELLENT 
GOOD'. 
AVERAGE 
/AIR 



Ptlor^ 



fiXCFLLENT 
GOOD 
AVERAGE 
FAIR 

POOR • r 



Low , 
HIGH. 



LOW 

HIGH 



LDH 
HIGH 



P-VALUE 
5 



0 10 

$M44444444444444444«4MM444M 



«i»««|fMM44444>t444444M444t44 
««M«444444444444$$444444444t44 
«M44444444444444444444444444M 
««««««««M4444444444444444444444 



M4444444444444444M4444^4444444$ 
««4i«H444444444444M44444«^4444 
M444444M44444^M444M444444$4 
««M4444444I44444444^44444444444 



im««$M444444444M44M4444444' 
m44M44$4444444f4444M4444M4 
t444444r4444444444M444Mll444444 
^ i»$«$4$$444«4444444444444444444l 



$$$4M444$4$4444444444444,4444$4 
$M4444444444M44444444444444M 

[ ■ 'fr, . . ' ■ 
M^$m$M444f44444444M4M4M4 
M4444444M4$ 4444444441444444444 
.t«$«$444444444444444444444i4444 
$M444444444444444MMM4444444 
m$$$$$*$$$$$$M44444M44 



«|t4444$$M44^44$444444$44444444 
««^M444444444''4M44444444.4444444 
««M4444il44«4444M444444444M| 
M44444W4M44444444M444M444M 

4^^. ■ ' ' ■ ' 

«M4*4444M4444M44444444444M 
M44#4«M444444«44i444$$$$44444 



«M44«444M4t|44444t444t4444444 
$«M444^4444|;44M444444444444444 



«$M444II444444444«444444444444 
M4M4VM4044444404M44444444 



•I t* ' 




Ill 



J- 4 



^N^lJim.f«ALUATIOH-S?'$7lR5, iNCi -tfifiDNIliNI ANALYSIS RPPn^llw; 'fajnuw*; 



:/ J't OF. {^6\jP ' St fjF 

t^-VALW; P-VALUE fFFECTv PFFECT 



0*56 1 



ffifO?. ' f.64 ^ Ot7ei». 

QHADE OH. IME STUOFNT 

. <»T.6l 104 -7.534 
W»»43 {»,r>3 l.?94 

--^HliiK DQ YOU Ft t'L Annul SCHOOL? 

^9*77 1,56 ; U5? 

0.09 *?.7fl4 0»7? 

5A.43 . :u6A ,-C,7l 0.41 

&h.t<^ Of 70 , 3, 04* 0»44 

54. !A ?.le *U0O 1,67 



1.04 

,0.y'»0 
3.70 



— -tlOf^FWORK - OPILL $m 
,57.03 0.f>j UP94 
^'S3.?3 ' 0.71 -U9)4 
52.66 n,9fi -2.4fl» 



0.34 

0.46^ 
C.8I 



SAMPLE 



1191 



J4 

.291 
19?0 
9 
I 



JOA 

307 

A40. 
103 



llf4l 

76t^ 
?7a 



— HfWewORK • READING A5SU,NED MAIFRIAL 



56,71 
b6.?0 
53.46 



0,93 
0.7] 
C.57 



1.574 
1.06^ 
I.(>n4 



0.6V 
0.39 

o«3n 



436 
919 
fl73 



™HlMrW0HK - WRITING ON ASSlGNEWOf^lCS 

51.41 2,38 -3.73 2.15 79 

55t70 > 0.94 ; 0.65 . 0.64' 504 

55.19 0.5? 0.05 0.2? 1647 



' ALL SIUDmS • 
, FtMALF*' '* 



MH GRADf 
71H GRIDE 
ftDl CRADt 

91H (mi 

lOlH GRAW 



, SlkONGLV DISLIKE 
OlSDKF , 
SCHOOL IS OK . 
LlKt . 

SIRONGLY LIKE 



DAILY 

WEEKLY 

MDNIHLV 



'DAILY \ 
WfEKLY' 
MONTHLY ^ 



DAILY 

WEEKLY 

MfNTHLY 

■ ■ < 



P-VALUt 



f 10 20 3C 40 50 ^3 k m 90 

|....N.M|o..|....|.,..|o..(M..|M.»|M»«ro.> 



M#»M4iMM44^*MM4t44M4M4 



44MM4M444$4ijMM4M«M49 



444444441444494444^ 
MM4M44444M44l444«$M4 
«$M4M44«U«4444444Mf944M< 
MM44M«444M44M44MM4M«44M* 
M4M4MM444H4li4MM44MM4M4M4« 



«M44M444444444M4444M44 
««M4||44444#4«4«44«4#«^««# 

44J^M4M4M444j»444M4i>44M 
«fl%4«4«4M4444444444444444M 
^m4M4«44444444f44M4 




M||4^H4.4444M44M444M44444I 
M4M444^M9M44444I4#^#«^M 
9«M4«MIM44f44944444«f44f 



/U4«4^M44M*M444444M4M44< 
«4M44444444«44444444«M44M 



l44MM4M4*4M44fmmi4^ 

4M44M44444««44M44444#m^^ 

444«444444W>4444M444n44444 



\] 



f J 



ERIC 



. 263 



s 

t 

, hlATlONAt^VA'tUAnOli SYSTFMSi INCi — CONTENT ANALYSIS RY KEPUrtllNO CROUPS 
NASSACHMSEIIS SIMEWlDE^OUCAftnNAL ASSESSMENT CUD 13 YEAN OLDS SPRING 1976 



0DJEC1IVE 2« KNOWLEDGE Cf ARILITlESt TRAINING. AND, PRElMlRATiON" 



SF OF GRdUi 
P-VALUf. P-VALUF £FF#I 


r»f OF 
FFFFC1 


SAMPLE 
SIZE 


' RFPORTINC CROUP, 
* '/ 






2>38 


ALL STWDTOS ' ' 


—•^lOMFWORK - WORK ON VnUR'OtjN 
W.41 Unfl -2,73 Utl 
S2.40 0.87 .?.7M 0#60 
50.11 . 0^52 0.964 0«'I9 


114 

402 
1709 


1 

DAILY 
WEEKLY , 
WPNTHLY 


- — lALKFD WllH CAREER OR 
,54.69 0.84 *0.45 
55t52. 0.56 0»3e 


GUIDANCE 
C.61 
0.22 


COUNSELOR- — 
550 

1669 . 


YtS 

NOT ■ . 


W|?H PARf^lV 
55.69 n.56 0.554 
52.42 Ot92^ '-2.734 


. 0.13 
f 0*76 


1930' 
298 


'us ' 

NO . . 


— -TLAKtO WITH FRIEND 
55.46 .0.53 0.32 
54,55> 0.66 -0.59. 


I 0.17 
0*57 


1734 V 
"487 


YES/ 
NO 


*-*-T/1K|'d WITH PERSON IN 
54.? J 0.«5 H).934 
55.92 ^ 0.46 , 0.784 


INTrRESTING JOB - — 
0*45 750 
0.27 .1458 


YtS 

NO , 


- — TALKFO WITHIIFACMER 
. 54.fl4 1.19 -0.30 
* 55.41 ; .0*49 J.,2T 


0.66 
OtiV 


334 
1878 




— -010 YHU t'VHR .TAKE A CARPER TEST? ' 
57V.1H' 0.85^ 2.244 0.6) 541 
55.16 0.59 0.04 0.36 TI85 
52.9? 0.88 -2.224 0.60 506 


■ . ^ 

YiS 
NO 

1 DON'T KNOH 



10 2(? 30 40 50 60 '70 60. 90 100* 
• «.. I .... I .. .. I . I *..f |.« itl « « «. |.<.« .j ««f f |*f «■ 

iM4444^4M>444H444llM^444;- 



P-VALUt 



M4#«4444i4l444il444444444.4 
$H44«M44M444fM4$44|44$# , 
$MIII4l4#4444444$4M$l$rM44 



$4l||||MM444^M4«$im4tM 
p^U4l4M444*f^4$^M44.' 



M4«444I444444444M«4«IM44<»4 
IM444444#IM44444im«Mi4 | 



«Hm0M4M444444mM444*4 
«M444444444#$«MM444M44t4 



«H444n4«4«4444«444444#l40 
M$$|$M4M4444I44I$4444^4444 



|t*$44M44»l44l4##$4»$M4444 
04m44*44444444444$4M4444 



M4l4fn4$44444444MmMI44M 
#MIM44$$4444$4444IM4444444 
4M*444444^444#4«444444|>44; | 



■ ■■264 



ERIC 



.2S3 



«A$SACMUSETTS STATlWIDf: EIWATIOML ASt^SSJCNT COO 13 



S RY REPORT INO AMOURS 



P-VALU: 
51^31 



SF. OF 
r-VALUE 

3.02 



CROUP 
CFFECJ 



0BJCCT)V|^2. KNUNLEDOE OF AFRtTlFii TR'AlNINCi . AND PKEPARA1I0N 

P-VALUr 

0 to 20 30. AO 50 hO 



St OF 
tFFECI 



SAMPLE 



0?1 A • 
^3fF3; 



0fl2 
2.96 



2238 



19fl2 
227 
2/ 



RC PORTING GJOUP 
AIL 5TU0FN1S 



- — SaimiING HELPS YQU THINK /^BPUT WORK? 



t)4.B4 

^4i7^> \ 
4fwI7 

Hf* 

ri.?? 

S5«4I 

«>.;2 



0»fl4 
t.33 



-0»35 



0>71 
&*34 
0*57 
1*00 



346 
116? 
520 
206 



MUCH AMF. YOUR PARENTS JNVDIV^D7 



0#95 
. 0.69 
0.65 
1.37 



.-3,934 
.0^27 . 

1.0H4. 
-0.2!> 



o.eft 

0.56 
0.35 
0>70: 



— -FAMJLV OCCUPATIPNAI STATUS 
I>6t«>l O.ftn 1.774 ' 0.34' 
?;4.b? C.f»5 -0.52 0.52 
50.24 J.26 -4,904 1.12 
1>2,.?'* 1.27^ :-2.7|4 U03 
40.61 l.M •^,464 1.56 



24 7v 

900 
473 



iimt 

15ft. 
212 
72 



— -DO .^OU WANT A 
56,3*^ , • 0/75 
5?.i(i4 < 0157 
fi4.07^ C|7fl 



JOB LISTED IN OURSTION 18?- 

1.25* 0.32 Xll^O 
-1.50* . O.Hfl V56 ■ 
-1.0/ .0.6') \\i 



- — DO YfU WNT A 
52.b?OfgJ\/.70 ^ 
f>f.54' Vf ,65 
55.6? \0,96 

—DO YlXi WANT''A 
47.4.1 1.09 
S6.6'-v 0.54 ' 
£2.lH .1,03 



JOB LISTED IN OUESTlOl 

-2.6?» O.A$ ' 6H0 

1.39* f.32 1154 

0.48 O.RO 401 



20?- 



JOB LISTfO IN OUfSTlON 227- 
-7.714 O.i^O • 246 • 
1.514 0,ier.:174l . 
-2.964 0,91 - . 4?4h 



YES 
NO 

NEVER GONE 



NOT VFRY USEFUL 
SUMFWmT USEFUL 
VFRY U5FFi(L 
I, DON* T KNOW 



HARDLY At ALL 
ONLY A. LITTLE 
QUITF.A WW 
A LOT 



HIGH 

MFDIUM 

LOW 

UNKNOWN 
NONE 



YES 
»N0 

1 DON'T KNOW 



YFS ^ 

NO : . * 

1 DON'T KNOW, 



YFS 
NO 

I OSn'T KNOW 



|..t.|....|. 



i44M444M44<4Mtt44MMIt44i 
4|fM4i44444M444M4l4M4444» 
i|>«M4444444444444HMflf4 



|MMMMMM44444M4444^4^ 
$$H44«4444M444M4444444VUI 
t$444«4$444M4MM4444l*i»44| 
$H44iM444M4M44M4M4« 



|$|M4444*4444M44M4444M4 
M4$f44M44M4M444444MM44t 
M4MM4M4444M4M4M$44MM 
«444^444^^M4444444>4M44444 



IM44M44M44MM44M4444MM 
«M44444f4M4H4444444«44444 
4|4M$MM44M44444M4444i> 
%%%%%%%%%%%%%%%%%%%%%%%%%%% 

MM4MM44*4444«4MM44I 



«M4M4Mt4M4M44M444M*4li 
MMt4M4MMM444M44*44M4 

««M4M4^MM«444«f<MM444 
M*«4MMMMM4MMM«44«4M 



M4*M*««M4#444M444M4MM« 



NATItm IrVALUATioN SfSUMJt ' INC. CON 1E|^ I ANALYSIS RY HEWRIINO GRQUPJ) 
HASSACHysrns 5JA:TFNI0F FDUCATIWL ASSSSMfNT COO 13 VtAH O^DS SIRRING l9Va 



ClHJKTIVF KNtmLtDGt [f AHh^lTlESi 



IRAININ^i 



P-VAIUF 



f.F OF 
P'-VALUr. 



{«OVP. 
FfFfCT 



5F (JF 
^FfECT- 



SAMPLF 
SI>C 



5UKF A«F YOU ABOUT FUlURC jnfl? 



WFNIS WANT YOU TO.GU TO COLLFGt? 



0.<r8 . 

0.77 



-6*761 
?.A6^ 



1.20 
D.37 



MO 

7n 

I0?2 



"^H^lMl DO YOU PLAN' 10 DO? 



A^•?7 
6C.-'7 



t.v3 

0.9i 

:i.6i 

0,65 



.a7* 

-3«66l 



1.01 . 

1.A9 
0.35 
0.4B 



199 
hi. 

2P1 
70 

910 

704 
4 



StPOPTiNO GRW 

ALL.r.uJorw 

: ■ * ' ■ 

NOT V6RY SURF 
' SOMFWIAiT 5URr 
VFhY SURF 



HAWOLY AT ALL 
ONLY A LRTLF 
OUITF A BIT 

A LOJ ' ' • 



FULL-TIMF JOB 
JOB-SCHOOL . 
SrttlAL TRAINING 
2-YFAR CILLECF 
4-YEAR COLLEGE 
OCf'T KNOW 



-^-HAVt 


YOU FVEH DONE 'RFGULAR WORK? 








0.5if 






1999 


YfeS \ 


•>3.fl9 


1.3? 


'-1.?6 


1.0? 


?33 


NO J 


— K INO 


OF COMMUNIJY ' 








49.43 


MB 


^5^.724 


\M2 


4,5ft 


BIG CITIES 




li39 


0.53 


1.29 


342 


iNOUSTRlAt 




0.60 


3.fr?4 


0J>0, 


iJ47 


RESIDtNTIAL: 


53.8b 


0.56 


-1.29 


0.60;- 


599 


01HFR 


— KFGION OF THE 


STATE 






/ 


55.51 


U50 


0.37 


1.16 


596 


BOSTON 


bb.62 


1.14 


0.4B 


1. 01 


444 


NCWTH^ASl 


65r39 


l.OB 


0.24 


M7 


204 


P1TI5FIFL0 


b4.6M 


0*94 , 


-0.46 ■ 


0.91 


385 


SOUTMEASl 


b3.AJ 


1.67 


-1.71 


1.60 ' 


235 


SPRINGFIELD 


5b. 2 a 


O.Bh, 


0.J3 


0.P9 


37? 


mi^CFSTEK 



PRE PAR AT KIN 
IP 20 



30 



.:.! 



P-VALUr: 

.50 ;>o 



MM4IMMMIM4MMI4MM4M 



%%%%%%%%%%%%%%%%%%%%%%%% 
%%%%%%%%%%%%%%%%%%%%%%%%%%% 




M$$M$M$$$$Mm4$44M«*4« 



• 4M$M$IMMM$$$«M4«4M4$ 



iM4MI$4M4IHtHMIIM4*4« | 



sif of' 

0i56 



OPOUP 
EFFECT 



SF riF. 
•FFFECT 



A. 



. . I.M 0.70 
54i55 1,38 -0.59 
. ,0.72 -O.U 

;. S^VPV ' 1.08 rO.J0 . 
'T ^- ' 

--KMPHASIS ON OBJFCTlVt B, 
« 56.85 0.95 1,M 
' ^f'J? ' '•22 -0.71 
55.42 ;. |.?o 0.?0- 
5J.J7 ^ -0.67 

50.^4 M4 :4.Qp4 

-:;-EMPp/aSIS on- OBJKflVF 
53.98 0.96 .-i.U 
56»4I 1.54 |.;7 

^55.92 0,97 0.77 

55#?1 t.46 0.07 

---HMPHWIS ON OBJFCTIVE D. 

1.13 -0.97 
55i24 1,39 0.10 
52.39 2.4ft ^2.76 
57.19 0.ft9 2.0B4 
^6.10 0.81 0.96 



1.57 
1.19 
0.79 

0.83 



>93' 
1.08 
1.07 
0.90 
?/l5 



1.04 

li40' 
0.75 ■ 
1.08 
1.34 



0*95 
1.26 
?i?4 
0.V4 
Di7H 



0. 99 
0*66 

1. ^0 
0.97 
1.17 



SAMPLE 
SI7F 

2236 



228 
429 
406 
237 
757 



398 
481 
448 

681 

r 49 



185 
326 
80B 
410 
352 



593 
400 
235 
285 
568 



---eMPHASiS ON OHJFCTlve F. 
55.65 1.18 0.50 
54.75 0.99 *O.40 

56.90 0.95 1.76 
55.05^ 1.16 H).09 

----ACHIFVFMENT RY STUDFNTS ON flBJECTlVF 
2.45 -2.66 2.46 tk 
•? '-09 0.77 7? 

5fl*84 1.38 3.70* |.0 121 



604 
611 

327. 
326 
2J3 



57.22 
55.13 
54.49 
56.95 



ACHlEiVFMFNT BY STUOENTS' wWcTIV^ 



• 2.55 
Ci9l 
0.83 
2.67 



2.06 
-0,02 
-0.65 

1.81. 



2.49 
0.71 
0.6? 
?,62 



9? 
827 
991 
l?4 



Rf PORTING CROUP 
ALL SiaqFNTS 

srcob 

THIW ^ 

FomTH.; 

.>FIFTil 

first' 

THIRD 
.FCiURTH 

SECOND 
THIRD 
FrtjRTH 
FIFTH 



FIRST 

■ SFcrmo 

THIRD 
FOURTH 
/iFT4 



FIRST 

SfCOND 

THIRD 

FOURTH 

FIFTH 



VERY SATISFIED 
SATISFIED 
niSSATISIFED 
VERY OISSATISFIE 

VrPY SATlSFIfD 
SATISFIED . 
OlSSATlSlFED 
VERY DISSATISFIE 



A .A P*VALUE 

}...:!...!i....:T;.:f...n,;f....i...;i.,.;i 

MM4tMM44MM4«MMM4Mi! ' 



tM444M44444444MM4$HtM« 
.fOt4t<4M4f4MIIMtM444|$| 

1 MM4MMM«m^M4MM440( 

tMMMnHMMlMHMIIMlil 

M44444^M4tOM4MM$M4Ml 

OMM.MM4MM4M4»44M44M 

4^04MMOMmM«i|4mM 




4M4l^«MM4MMMt44*tMMt 
444444MM4MM4444ft|444M44< 
MM4MMMMmM«l4^lM44| 
4l#4MO«MM|«M4MMOMl | 

Mt04l;l«Ml44«M4M4f«li|*j| 
M44M«M|4*444M*M«4V3K* j 
4m#«r44MI4tMi4MM4MM44U 

4ttM40MM44M4M44MMAM 

M44^MMM4M4MM4mm4«M 
MMMMMMMlff4#MMM«H 
|4tlMM4«MMMM^MM44IH4 



M«yM4MM4M04MM«tMMi!« 
«M44M«MMMMMMMMM4M 
MUM4M44«MMMMM4M^M| 
«MI>t*IMMMM4444«MM«m 



I 



NAIKINAL IVALUArillN SYSTEMS. INC. 
MASSACHUSETTS STATMIOF FOUCATIONAL 



i 



;0N7FNT ANALYSIS BY RFPORlING GROUPS 
S5MENI COD 13-YEAR DLDfi SpRINO I9T6 



OTJfCUVJ^ ?. KNWLFOGt OF AHllUlFS. IHAINING, ANP F«EPARATION 



■5F OF 
P-VALUF 

0•b^ 



CROUP 
FFFECT 



/OF 



5AMPLF 



— :.AOIIFVEMtNT BY STUDFNT5 ON (leJECTIVF C* 
1.35 -Oi6? 1.^2 50 
. t*.3J ' 0.96 0,1ft 0,77 740 
5,6) 0i80 -0.^7 0.54 1153 
5^.58' 2.23 3.** /'^ , 

ACHIFVFMENT HY STUObNTS ON OOJECllvF D, — 

63»13 *0.t9 7.99* I. OA ?3 
SsIm 0173 O.tiO l?69 

M»M t»0S M.3^ 0.fi7 64? 

.59,e4 A. 704 75 

-r-AfHirVEMENT BY STUDFNIS ON OOJECUVF F. — 



5Bf4 3 
54#7« 
*55«76 
51 .6 7 



If40 
0*67 
1. 39 
2»67 



3.29* 
-0.3ft 

0.61 
-3.^7 



1.42 
0»45 
1. 17' 
2.6f 



^ — IS YOUR SCHOOL AN ESFA lllLFt I 
56.7b \ 0.74^ l.il* 0»57 



M3 
1319 
Wl 
50 

sCHoa? 

965 
1 07 J 



PARENIAL SUPPORT OF. YOUR SClfoOL? ^ 

55.98 0.97 0.64 0.79 703 
56*12 9^7? 0.98 . 0.65 B49 
53.23 l»25 -1*91 MO 438 
51.77 i»7«, -3.37 3.ftB ft* ^ 
4T.12 |10t| .;-fl»02* 1.07 25 

-^-ATliTOOf .^ STUDENTS TOUApo SCHOOL? 
5&.5aj| 1*13 0.36 fl.O? 44a 
56.4# 0.tf 1.31 J 0.60 . 99ft > 
5?.04^ \m -3.10^ 0.94 h92, 
54.15 2#34 firO.99 ' 2.35 5( 
0.0 0.0 -55.l4t 0.55 



ATTENOANCE^IRST OUARIER 
53.24 • 0.05 -1.9fl». 0.56 
57.3B 0.59 2.24* 0.58 

ATTCNbiNCF SFCONO OUARTtR 

53.ft3 1.07' M.5I* C,75 
56.n 0#56 U29* 0.53 
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«*4444444444444444«f 444444444 
1^^44444444444444444444444444 
M4444444444444444^444444444 
M444444444444M444414444444 
'mM444444444444444I44 



M4jl«4t444444 44444 IM444I4444 
4444444444444444444444444 44444 
HM444444444444444444I4444 
$4444444*44444444444444444441 

4' 



M44444444444V444444444,^444 
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MM444<I444444444'44444444444 
|4^M4444444444)»44444444444444 
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M OF 
r-VALUf 



Hh]\mi IVALUAIION SYMfMSi |N<, - (ONIFNI 
MASSACHUr.KII5 STAUKIOf FOUCAl IHNAL AS5« SSMffNT 

nflJttiivE V. APri.ic^TinN OF m\x skills in 



ANALYSIS nv MtPOIMINC (iNDUPS 
COD n YMM UL05 M»niNo I9y« 

SfCKING MrLllYMtNl 



O./l 

— 5K< OF llf ^lUDFNt 
7A.h^ 0i7l U^Al 



^b.r I 



•CP#Or OF TMf SlUOtNT 



l»ry 



i.6nt 

-I.M* 



0«3fi 



i.n 

tJ.?7 
0.71 



--r-MOW nu YOU FFFL AHOUl SCHIKJL7 



71. '»Q 
7l)f4? 
7?.?7 



t.J( 
1.13 
0.76 

.0. 79 



-Aioni 

-0.71 
2.7M 



U.PH 

D.AO' 
I.V7 



119) 



14 

?VI 
|O?0 

I 



104 

H40 
103 



— -MDMFirWK OWILL *DWK 
/4I49 .>.7^ |,77* 
71. C4 f^tP% -1, 691 
/f'.Irt l.?4 -2,5!^^ 



rO.AB 76ft 
0.97 ' ?7ft 



— HOMurp - HtWiNo ASSICNPD ^iaif'riAl 

nrff«» ' I.M 0.3ft 0.77 ' 4.16 ' 



73J44 
71". S< 



0.K7 



-OfdO 



0.47 



919 
' fl73, 



— -MOMFmiMK - WHMINC ON^ASSlGNtO TOPICS 
^^•Ol J.J5 -3.7? 3,04 70 
73. Oa I. Oft ^ 0»?7 ' O.fK^ !SC4 
7?.ftb O.ftft \ O.I? O.ji.. 16^7 



AU MUDINI 



1' 



M.MAl! 



1» 



(IH^CPAPl 
7TH WUDt 
HTM f-RAPf 
9lH f^AOl 
lOTH CflADIi 



SIMnNCLV DISLIKE 
UISLIV 
^ SeHMPL IS OK 
llKF 

DTHfiNGlY LKF 



OAIl,Y 

iJtfKLV 

MPNIHLV 



DAILY 
XtfKLY 
'WONIHLY 



^ DAILY 
WfEKLY 
MUNfllY 



P-VALUL 



»,™,.c.«nu. j.Jt..ji.Jt..,:i,4/'.yi 



M4MMMMMMMMMMMM|lVMa4M< 



MMM44M#HMMMMMMM4MM4M4 
• MMM4MHMMMMMMMIMM4MMM 



MM4MMM«M«MMMM 
MM4MM4MM«M4«M44tMMMM 
MMHM4MMM4«MHMMI«|«MMM«M 
M44MMM4MMMMMMI^H«MM4I44M4M4M 



M$4MM4Mil4MMM4MMM4MH4«M« 



MMM444M«MMMMM*44MMMM44 
MM4«OMMMiMMM444«««*MMM4r 
MMMMIMMn4MMMMMMM0444t 
4MMMIMMMMM«MM4M4MM4MMM4 
IM4MM4>MMM4M4M4MMMMM44M 



44MMIMI#iM«tMlMi4MM44M4«4M«4 

«Ml4«tMMMMM444*MMMMM4MMM 

MMMlMM4MMMtM4MMMMMMM 

*Mf4M4M44M4MM|44M44MMM44M4 

«4ti»M444«44MM4IMM444MMM44M44« 

M444M4444y444MMM4M44I^IM4f««4 



iMM4MIM44MM44M44tMM4M4M44 
^^M44444MM4444•M44tM4M4*4444M^O 
IMM444M4M4M44M4 444MH,4M44«M» 
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NATIONAL eVALUAIION JiVStEMS. INCi ^ CONTCNI 
MASSACHUSniS SIATFWIDE EDUCATIONAL ABJESSMENT 



ANALYSIS DV fHPOHIINC CMOUPS 
C(K) 13 TEAM OLOS SPHIMG I97B 



SF OF 

P-VAUr F'-VALUt 



EFFECT 



OOJCCIIVE 4. APPLICATIUN OF PA5IC SKILLS IN SFFWING EMPLOVHENl n 

P*,VALUP 

I0„ 20 30 40 ^50 60 70 M n 1 

««*ir»i«*|«»M|tfi»|«*»i|»»»«|»tt«l|«*M***M**** 



SE nr 

tFFFCT 



SAMPLE 

Sin 



0.71 



-.-.HIIMH^URK - WOKK UN YOUH OWN 
(7.03 ?..''l -t^.TO* 1.95 
(»9*76 1.16 -?.97* 0.7A 
73.01 M?. MP* . :0.?6 



114 
40? 



•t'alKEO WMM CARFFR or GUIDANCE COUNSELOR 



7l.r)M 



1.13 

0«66 



-I* OS 
0*564 



0.72 
0.27 



S50 
1669 



— -lALKFO KITM PARENT 
73.17 0.73 0*444 
71. '.6 0«96 -Ii674 

- — ILAKro'lillH FRIFNO • 
72i6> 0.65 0»18 
72>? t.ll 0.09 

— lALKED WITH PERSON IN INHHESTINfi JCO 
7M9 0.98 -1.544 0.47 750 



0*14 
0.?9 



0*21 
0.66 



1930 
29ft 



1734 
4fl7 



73.fi Ij 



0.62 



I.0A4 0.2P 145ft 



7Z.t>9 1.40 -lO.U 0.95 334 

72.93 0.64 0*20 ,0.21 'lfl7B 

—DID YOU EVER TAKE A CAREER IFST? 

74*4B fl.9fl 1.754 0.61 542 

73.22 3.77 0*49 0*40 Ila5 

69.B3 1.03 -2.904 ,0.6ft 506 



RKPORTINC GROUP 
ALL STUDFNTS ' 



DAILY 

KFFKLY 

H(jNlHY 



YES 
NO 



YES 

m 



YES 
NO 



YF5 
NO 



YES 
NO 



YFS. 
NO 

I O0N»T KNOW 



100 



$M44MM444M4IM4M44M44$M444MM 



IM4444M4M4M4444444444M4M4M44 
^M44444M44MM4M44l.«44MM4M4444 
M44444444HMMMi4M4444M44M44MM 



M44444M444M44M4M44444444444444« 
MM444M4444444444444444M44IM4444I4 



MiM4444444M4t44MMH44MM44M4M4 
M44444M4M4444t44M 4414144444444444 



tM4444t4M4M4444M4444444444t4M4M 
MM444444I4|4444M44444444444444444« 



M44444M«44«44444444444II4M4MM4M 
MM444M44M444444t444M444M444444M 



^M4M44M4M4I4MM444444MM4444IM 
MI4t44444tMtM4«44«4Mt4«4MMM44l 



44M44M4444444444M444444444444444M4 
IMM444444M4M44M4444444M444M444I 
Mt44M44444444l4444M44«4444M444M| 
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HkWmi fVALUMIQN SYMtMS» INC. -n CONI^NI ANALYSIS F^Y MCPQIMINC (ihOUPS 
MASSACHUf»niS SfAlFlflOF^FOUCAlIIINM. ASJ'^SSMFWT COO 13 VMR OLOS iPRINO !9?fl 

OBjeCllVf. 4. JPPUCAlinN op WSIC skills in seeking tHflUYMENl 



* 5f OF 

p-vair r-vALUF 



. OHOUP • 5F \f 



™-5ti« OF 1HE SlUDFNI 



70 .'I 
74.67 



a«7i 



I.VA», 



0.39 



sami'lf: 

5!7r 
??3B 



lOM 
IIQI 



■"-CPAUF nr THF SlUOtNl 



HOW DO YWrFFFL m\}\ bCHllOL? ^ 



6 

74.41 

7U0i) 



0#67 
4*47 

^00 



-9;75* 
-l.7.1# 



69.1/ 

7i,*>q 

7b.4; 
7?.?7 



M3 
0»76 
0»79 
?#37# 



4* dm 

-0.74 
2*744 

v0.4lS 



0»40 
i.V7 ^ 



14 

?9I 

]fl4 
^ 307 
Ptt? 
B40 
103 



----MOM f. WORK - DRILL WORK 
74,49 0.7^ 1#774 
71fC4 ^N -U<)Q4 
70,|R 



1181 
76fl 
0.9t. 27fl 



0iJ(< 
0*46 



™.-HnMFWORK - REAOINO ASSICNFO MATERIAL 

73.cn I.U 0.36 0.77 43ft 

73.4^ 0.71 0.4? 919 

71.^1 0.75 -0.80 C.M 873 

MDMFmilK - WWITING DM A5SIGM0 lOPItS 

69.01 ' j.J5 -3.7? 3.04 79 

73.00 U06 0.27 0.63 ^04 

72.8^ 0.66 0.1? 0.25 1647 



REPORIING. GROUP 



MALE 
Ff.MALE 



('TH WADt 
7TH GRADE 
m GRADF 
.9TH GRAOI- 
I01H GRADE 



' SIWn^WlY DISLIKE 
" , DISLIKE 
SCNOOL IS ,nK 
LIKE 

WRONGLY L-IKE 



DAILY' . 
IfEF.KLY 5 
MONIHtY 



DAILY 

WtFKLV 

MONTHLY 



DAILY 

WEEKLY 

MUNTIIY 



0 



P-VALUt 



I ^1 ^1 'I ^1 <j «| 90 



«4MM4MMMM4MM4M4444ltMMM4 



«M^4M«,MIMH44M44444MtM44M44 
MMMMM4M4MMMl44444MMM4444«f 



M44MIMM44444444MM 
MM44*M4MM44(44M4MM444MI 
MIM444^M«M44(444444M44M444M44M 
MMM44M4MM4M4Mt44«4444|4f444,MMMM4 
H0M444M44 444(4M44M4MM4444M4 



IM444M44t44 4M44M4M*444444M444 
4M44M444#,4M«m4'44444M44MM4M4 
t4M44M4M44 44tM44444444MM4444IM " 
M4M4MMM4MM4M4444M44M444M4M4 
M4M4MMi44M4l44M44iiM«MM»i«44 



4M4M44444MI4444M44M4 444M44M44M 

«M44IM4444M44444444M4^44f4444M4l 

,«MMMO«444«44M4444444MM44IM44 



MM4404444MM44M44M444444444444M 
H MM*M4444444M44M44M444444444#4MI 
««M44MH4M#4M444444«44444M4440« 



M^M4«4M4«'M4l4444M4ill^M44MM4444 
ft^*4444*M4«4444f«44M444444444444M#44 
:^V2WmM»I4MM444M44M4MMMM44#44M4 
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NATIONAL ^VAl^jAMON SYSICMSi INC. CUNTrN! ANALYSIS MY RFI>ORl|Nri mm 
MASSACMUSFUS STATlWlDF FDUCATIONAL ASSESSMENT COO IJ YFAR OLDS SPRING 1979 

mjtcnvii ^ application df hasic skills in sctKiNc f^oyhcnt 





sr UF cwnup 




SAMMLF 


»*vAnr 


M-VALUF EFI^FCT 


ffffct 


SUF 




0.71 \ 




?M6 


ARF 


FIFLO TRIPS USFFUL 








f.7? 0. 


0.13 


19B? 


7I.H7 


r.?? *l.lfi 


1.07 


22? 




:ii53. -6.J9 


3.40 


27 


■— ?CHOnilNf. HFLP5 YOU THINK APOUT 


irpRKT 


71.93 


0.9? 'OiHO 


. 0.66 


346 


74 


0.60 l.93« 


0.33 


1162 


71.4? 


1.17 ^1.311 


0.6f> 


fi20 


M..7I 




1.16 


205 


— rHW MUCH m YOUR PARENTS INV0LVFD7 


70.Jfl , 


MB 


0.9b 


247 


73.03 ■ 


Q.7P 0.30 


0.S9 


616 


73.f'9 


0.79 O.RM 


0.3R 


900 


77.01 


1.22 -0.72 


0.75 


♦73 



•r-f*»iiLY occupational status 



RrpnRiiN(f group 
all Studfnts 



YtS^ 

NFVtR GONE 



NOT VERY USEFUL 
'Mltm USEFUL 
VFRY USEFUL 
I DON«T KNO* 



HARDLY AT ALL 
ONLY A LITTLE 
QUITE A OIT 
A LOT 



74 .;9 0.77 


I.b64 


0.35 


\m 


HIGH 


72.99 . 0.77 


0*26 


0.65 


606 


MEDIUM 


67.fll ' 1.S6 


-4 .92* 


l.!<0 


i&a 


LOW 


6V.»1 1.26 


*3.224 


0.94 


212 


UNKNOWN 


M.7? ?.?1 


Hl.OU 


2.03 


72 


NONE 


DUvYOU WANT A 


JOB blSTEl) IN OUfSTlON 167 




73.74 J0in6 


l.(U4 


C.34 


1160 


YF^ 


imi o.e? 


-I.7M 


0.S3 


656- 


NO 


72.78 0.91 


o•o^ 


0.70 


417^ 


1 OON'T 


— -00 YOU WANT A 


JOfl LISTED IN QUESTION 20?-— 




60. 4S O.W 


•3.2F4 


0.43 


6fl0 


YES 


74.21 0.76 


I.4B4 


0.29 


1154 


NO ^ 


74.19 n.94 


1.46 


0.79 


401 


1 DON'T 



—00 YOU 'WANT A JOB LISTED IN OUESTlUN 227- — 

66.95 1.26 *5.7B4 0.9tf - 246 YFS 

7:SB0 0*69 1.074 . O.IB 1741 NO 

71.06 1.13 -1.67 O.no 24R I DON'T KNOW 



P-VALUr 

)| 10 20 30 40 50 60 fO HO 90 I 
....|...,i|ii.t|ii..|«...)..i.|..i.|«iii|ii*i|«iit 

IM444444444444444444 444444MI44IIMI 



100 



,MI4444M4IIIMI4IIII4M44 4411 

1444444144444 •44144444444444444444444 
M4IM444444M444444444444 44444444 



M44444444444444444444444444444444444 
M444444444444444444444444444444444444 
4444444444444444444444444444444444444 
M4444444444444444444444444M44444 



144444444444444444444444*44444444444 
1444444444444444444444444 44444444 44444 
14444444444444444444444444444444444444 
4444444444444444444444444444444444444 



44444444444444444444444444444444444444 
l44f>444444444444444444444444D444444 
110444444444444444444444444441)1444 

I444M4444444444444444444 444444 

M4444444444444444444444444444444 

\ 

•4444444444444444444444444444444444444 
$M4444444r>44444444444444 44444444444 
44444444444444^4444444444444444444441 



444444444144444444444444444444444444 

14444444444444444444444444444444444444 

44444444444444444444444444444444444444 



4444444444444444444444444444444444 
44444444444444444444444444444444444444 
4444444444944444^4444444444444444444 
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NMIDNAL fVALIMTION SYMCMS* INC. - CONItNT 

MfSACHustTis bnmm mif^umi ASffssMFNi 



ANALYSIS RY ReMOPIlNG GHQUrS 
m IJ YM« OLDS 5IHJING 1970 



nHjrCtlVF A. aVplICATIQNOF basic skills in SPFKINC tMPlAYMt^J! 



* P*VALUf. 



St OF 

P-VALUE P-VALUf 



sr tf 

tFFfCI 



0.71 



SAMPIF 

si;t 



•—HfW t'UHf ARF 
71. 0.99 

Mifth 0«69 

7?i?f» 0.99 

....pj^J^MlS NAN1 

fri>..U I.7A 

fi9«'7n 1.01 

7.1.01 C.6() 

M.AO 0.97 



tOU AbW)! FUlUHF J007 

•i.iTi o.^9 ^o^ 

0.931 O.AO 1023 

.^0.47 0»M 70^ 

YUU 10 GO 1U COClFGF? 

'7.A1I lifB 149 

• -?.9^* 0.B9 ??a 

0.2A O.M 771 

1.671 Q.A3 10??, 



***^NHA1 DO YOU PLAN TO D07 
K«OB 
M.57 
7(f.0fi 

rKOM 

r9.93 

-*-HAVF YOU FVFP DONE RE(iULAR 'kORK? 

?3.0i: 0.6B 0.2VI OJA 1999 

71.07 1.33 -1.^6 0.95 233 



1.36 


•A .651 


I.IV 


109 




-ll.lbt 


2i96 




l.t9 


*0.67 


OiCS 


2H1 


l.?A 


•0.57 


1.35 


70 


0.ft7 


A. 351 


0.37 


910 


O.Bl 


*2.809 


o.An 


70A 



-"KINO I# COMMUNIIY 



73.1S 
7t..f«2 
7I3.I? 



1.69 
1.39 
C.67 
0.7ft 



-6.1AI 
0.42 
3.794 

0.39 



1.45 
1.3ft 

0.78^^^ 

i^.yo ■ 



450 

^^34 2 
«47 
S90 



RFPDRIINO CfllWP 
ALL SlUOfNIS 

< 

NOI VFRY SmU 
SnMCNHAT ^UHF 
VERY SURt 



HARDLY A I ALL 
PNIY A LHTLF 
QUITE A BIT 
A LUT 



FULL-TIME JOB 
JOfl-SCHOOL 
!)PECIAl TRAINING 
?-YEAR CCLLEGE 
4-YEAR CfUE-GE 
DON'T' KNOW 



YES 
NO 



01G ciTirs 

INOU&Tt^lAL 

RPSIOEMTML 

OMR 



r ' Ip 2C 30 40 50 Op 7C BO ^ W 

|...l[.lM|..M|t.f.|«..l|..f.|....||Ml|.M«|l.ll 

M44444M4444444444M4444IMMI444444 



MM4444444444M4II444444MM4M4444 
IH44444444444444444I4444M444M4MM4 
M44444444444444444M44M44M44M4444 



•^-"RFClflN OF THE 


SIATF 








71.6/ 1.90 


-liOf) 


1.46 


596 


' RUSTON 


7?.?7 : I.S3 


-0.46 


1.34 


444 


t^UftTHtAST 


0.65 


2.924 


0.94 


204 


PITT5F1EL0 


72. ea 1.27 


0.12 


1.21 


385 


SOOTHFAST 


72«2b 2.04 


-0.4B 


1.96 


235 


SPRINGFIELD 


,74. 3A 0.79 


1.61 


0.96 


372 


*mCESTFR 



IMM4444444MI4444444I444M44444I 
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IM44 M444444IIM4M4IM4444f 
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IM44444I4M4 4444444MM44I4M4M4MI44I 
#IMM4IIM444M444MMM444l4M44f4 



M44I4II44444444M44 4M44M4M44M4M 
M44M4444M*44IM4444mMIMM4MM 



IM44444444M44I4M444444#M444M 
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IM44444Mtl4444t44444444444M444M4M4 
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NATIONAL rVAlUATION Himh INC* •• CQNTIiNl 
MASSACMUSMIfi 5MUIIIDI; rOUCAIIIINAl A&I^CiSNtNt 



OBJCCtlVh 4. APMLKAIinN OA&IC SKILLS IN if.Hm 




W (f CROUP Sr V SAMPLf 

p«vAim MAiui rm.a f.rna im 

r^iH o.ri 7?j0 

— -IMPHASIS ON ODjrniV! A, 



7J.09 


1.19 


0i3^ 


1.27 


m 


1\M 


Ii92 


-o.n 


I.M 




T4.45 


0.90 


1.7? 


I.OI 


m 


T3.0t 


1.76 


0»3I 


1.^9 


til 


71.48 


1.49 


-1.25 


l.ll 


7S7 



•CWHASIS ON OBJTCTlvr B. 



T4.i; 


I.OI 


1.39 


I.Oh 


J9? 


7M6 


1.26 


-0.55 


1.19 


481 


73.38 


1.93 


0.65 


1.35 


44N 


71.70 


l.«? 


•1.03 


I.2A 


AAI 


(if>iJ>3 


7,47 


•A. 50 


7.3? 


49 



HiPo«?iN6 wour 

MUDtNIS 

FIRST 

IHIND 

FtHJMTH 

FIFTH 



FIN5T 

SCCONO 

TMIRO 

FOURTH 

FIFTH 



-EMPHASIS ON OBJfCTIVE C* 



73*4 1 


0.84 


0.68 ' 


1.03 


185 


FIRS? 


73.01 


r.92 


0.29 


2,27 


Xf> 


StCUND 


73.09 


l.ll 


0.36' 


0.97 


808 


THIRD 


70.65 


i,;i 


-2.08 


1.53 


410 


FOURTH 


73.10 


1.79 


0.3n 


l.fiS 


357 


FIFTH 


WPHASIS ON OeJFCTIVF D. 








71.60 


I.S6 


-I.'I3 


1.27 


593 


FIHST 


7t.07 


1.63 


• 0.14 


1.51 


too 


SECOND 


68.1(4 


3.61 


-4.49 


3.27 


235 ^ 
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NAIlilNAL i:VALl>»nON'SYSTFNS\ INC. - (ONIFNI ANALVSJS Bf^FPOHTlNG CROUPS 
'MASSAtfHUSMiS SIATCillDE bUPA^igNAC AS^HSSMFNT COU 13 YEAfe OLOS SPRING I97B 
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bBJKTIVfc 5. PERSONAL AHITUOTS AND VALUES CONTRIflUIING 10 SUCCESS 
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NATIONAL EVALUATION SYfiTEMSt INC. — CONTENT ANALVSI S VrEPURTINC GROUPS 
MASSACHU!iETT5 5TATEWIDF EDUCATIONAL AS^ESSMFMl COD 13 VFAR OLDS SPRINO I97B' 



OBJECTIVE 5* PERSONAL ATTITUDES AND VALUES CONTRIRUTINC, TO 



^UCCESS 
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P-VALlf- I'-VALUl- EFFECT 
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EFFECT 
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NATIONAL EVALUAIIUN SYSUMSi INCi -- CONIENI ANALYSIS BT RfPOHTINr, WQUPS 
MASSACHUSF.T1S SIATFWIOF tDUCAlKjNAL ASSESSMENT CUO \i YEAR OLOS 'SPKING 19?e 



M-VALUPy P-VALUf £FFECT 



OBjECIlvr 5. PERSONAL AUIlUOES AND VALUES CnNlRIOUTING TO SUCCESS 
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NATICNAL feVALUATp StStliHSi (nC. - CONTCNI ANALYSIS flV HE PORTING 0RUUP5 
MASSACHUSEllS STA7WI0E EDUCATJCfMAL ASSPSSMtNt COD 13|YEAI? OLUS SPPING 1978 



SI: or CROUP 5E OF SAMPLE 
l»-VAM.^ P-VAlur EFFECT EFFECT 5l7t 



oajrcilVF 5. PERSONAL ATTITUDES AND VALUES C0NTP|6UT|N0 TO SUCCESS 
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65 
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*1.|4 


0.67 
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69.74 l«68 
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70 
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0.34 
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0.12 


1999 


69.0?,, 1.17 


'^•83 
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-0.02 


1.08 


34? 


>3tl3 0.57 
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4M4444«444«4M444M444444444I44«4«« 

M44444444444444444444«««4«««$«««t4«| 

*M44tM4444444444M4*444444444444M 

«444|I|4«4444444M4444«M4444444«M«4 

M444444M«4M444«4$444|A«M444444444 



r 



■J 



> 



3 



\ 



NATIONAL PVALUAIION SYSIEMS. INC. CONIfNT {NJiySlS BY «EPORn^ GHO^^^^ 



MASSACMUSETTrSTATF^^ AS5ES5HENI COO IJ-YEAW 0L05 SPRING I97B 

f)« PERSONAL AITITUDFS AND VALUES CONTRIBUTING TO 'SUCCESS 



OBJFCTIVF 



•Sf OF 
P-SVALUF 

0.61 



CROUP 
fFFECT 



P^VALUE 
69iA5 

-•*-EMPHASI5.0N 0Q)KTIVE Ai 



SE OF 
FFFFCT 
$ 



71.98 
66.79 
7I«IS 
70.76 
66.63 



0*76 
UA3 
0.60 
1.52 
1.35 



M3« 
*l.i)6 
1.30' 
0.90 



EMPHASIS ON OBJECTIVE B. 



71 #42 
69.67 
69.29 
69.46 
66.97 



0.77 
1. 10 
1.54 
1.29 
5«24 



1.57 
-0.18 
*0.56 
-0.39 
-3.89 



0. 90 

1. ?5 
Oi76 
1.47 
0.9P 



0.65 
1.03 
1.31 
1.02 
5.14 



-EMPHASIS ON OBJECTIVE .C. 



71.15 
70*68 
70.24 
67.49 
70.14 



1.06 

1.92 

l«OI, 

1.54 

1.00 



1.29 
. 0.63 
^ 0.3A 
-2.37 
0.29 



1.14 
{•71 
O.BO 
1.35 
1.03 



SAMPLE 
SI7E 

?23P 



22n 

7406 
237 
757 



398 
481 
446 
6BI 
49 



165 
326 
808 
410 
352 



eMPHASlS DN OBJECTIVE 



66.74 

69«ao 

66*02 
71.65 
71.22 



1.06 
1.66 
9.92 
1.00 
0.74 



....EMPHASIS ON OBJECTIVE E. 



69.63 
69.49 
67.96 
71.70 
71.17 



1.63 
0.96 
1*65 
0.56 
].01 



ACHlfVfMENJ BY STUDENTS 

69.00 0.74 -0.65 
70.37 1.16 0.52 
69.09 0.64 -0.76 
73il9 1*64 3.34 




OBJECTIVE A. 
/0#94 44 
0.91 757 
0.5B III? 
1.65 . 121 



-ACHIE^MENT BY STUDENTS ON ORJFCIIVE B. " 



71.37 
69.91 
69.04 
73.64 



t«21 
1.01 
0.96 
1.60 



1.51 
0.06 
-0.61 
3.9?^ 



I.?9 92 

0.79 827 

0.6B 991 

1.64 124 



REPORTING GROUP 



STUDENTS 



FIRST 

SECOND 

THIRD 

FIJUHTH 

FIFTH 

FIRST 

SECOND 

THIRD 

FOURTH 

FIFTH 



FIRST 

SECOND 

THIRD 

FOURTH 

FIFTH 



FIRST 

SECOND 

THIRD 

FOURTH 

FIFTH 



FIRSI 

SECOND 

THIRD 

FOURTH 

FIFTH 



VERY SATISFIED 
SATISFIED 
niSSATISIFED 
VERY DIS5ATISFIE 

V 

VERY SATISFIED 
'SATISFIED • 
0IS5ATISIFED 
VERY DISSAIISFlE 



0 10 



P-VAtUE 

5( 



70 60 90 100 



0 5 20 / 30 4 0 5 0 60 7 0 60 90 



M«MM4#MrtM4lMM44MMMM4*«M4 



M4iMMM44M4MM444M44M4NMMM 
M4l44MM4MMMM44M4MMMM4M| 
t«M4M4M44M4444M4M4MMMMI«(40 
M4M4M444MMM4M444MMMM4MM 
«MMMMIi444MM4H44MMMM4MM ' 



^M4MMM4M4M44l444tjm44t4mMI 
|tMMMMMMMMM4Mm)M444MM 
«M44M4M441««M4MM4M4MM44MM 
MMM4M44^AmMMM4MM44MMM4 
«M^4MM44MM444M.4M4M<44MM4 



MMMH444MMM4M4444MM4444MM4 
«MM4M4MMM44M4MMMI4IM4MM 
«MMM4M444M4MM44M4M44M4^«44 
$MtMMtM4Mf4MM4444MMM44MI 
«M4M|IM444M4M44444HmM44M4i 



tl 



«OM4MH4MMM44MMM4MM44M4 

*M4MMM4MMMM44M4MM4MMM 

miM4M*4MMM4MMMMMM44MI 

M4MMM«4MMMM4MM4M44M4MM4 

tM4MM444MMM444MM444MM444Ml 



M4M4MM4MMM$M44M44MMMMII 

4MM4MM4MM4M^l44MMM4MjMliM 
M4M4MMM4MMM440444MfMi^4M| 
«M44444444M44M4M4M4MM4MM4IM 



IM«««M444I4«4M4I444MMM4$$4MM 
|MM«4M44M4MMM4MMM4M4M4M 
M«M4MM4IM4IMM4M4M4MM44MM4 



M«4MMM4M4M44M4444MMM44MM0 . 
M40M4M4MM4MMM4MM4M4MM4 
«|MMMM4M4MMM4444MMM4444M 
tM4MMMM4MM4M44MMMM^44MM4 
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NATIONAL EVALUA1I0N SYSTEMS* INC. » CONIENI ANALYSIS OY REPORTING GROUPS 
MASSACHUSETTS STATntlDF EDUCATIONAL ASSESSMENT COO 13-YEAR DLOS SPRING 1978 



P-VALUE 
69.A5 



$f OF 
P-VALUE 

0.61 



GROUP 
EFFECT 



nOJFCTIVE S. PERSONAL ATTITUDES AND VALUES CONTRIBUTING TO SUCCESS 

' SF OR SAMPLE Q I 

EFFECT SIZE ' 



?236 



> 



ACHIEVEMENT BY STUDENTS ON OHJECTIVF 

71*20 1.31 1.34 1.40 SO 
70.09 1.22 0.24 0.91 740 
69.21 0«77 -0.6S 0.50 1153 
75.3? 1.66 b.47» |.6H 9ft 



—ACHIEVEMENT BY STUDENTS 



79.57 
69.7(1 
69.03 
76,47 



0.63, 

o.ns 

1*01 
1*48 



9.7I4 
•0.07 
-«.82 

6.62* 



ON OBJECTIVE 0. 
0.(i7 23 
0.53 1269 
O.ea 642 
1..S5 75 



ACHIEVEMENT BY STUDENTS 

74.52 1. 10 4 . 674 
69.27 0.78 -0.58 
70.C6 1,39 0.21 
71.17 0^49 1.3? 



ON OBJECTIVE \, 
1.19 143 
0.4R 1319 
1.19 521 
0.77 SO 



fS YOUR .SCHOOL AN ESEA TITLE I SCHOa? 

6R.00 0.93 -1.854 0.66 985 
71.47 0.78 l.6?4 0.6? 1073 



-WARENTAL SUPPORT OF YOUR SCHUOL? 



70.82 
71.88 
66.10. 
67.23 
.58.04 



1.07 
0«S5 
1.52 
2.77 
1.26 



0.97 
, ?.03» 
-3.754 
-2.62 
-II.8M 



0.H7 
0.66 
1.31 
?.73 

i.3r 



703 
M9 
43B 
66 

?5 



ATTITUDE OF STUDENTS TOKAflO SCHOOL? 



REPORTING GROUP 
ALL STUDENTS 



VERY SATISFIED 
SATISFIED 
DISSATIS'IFEO 
VERY DISSATISFIE 



VERY SATISFIED 
SATISFIED 
OlSSATISlFED 
VERY DISSATISFIE 



VERY SATISFIED 
SATISFIED 
DISSATISIFED , 
VERY DISSATISFIE 



YES 
NO 



EXCELLENT 

GOOD 

AVERAGE 

FAIR 

POOR 



/I 



71,65 Ii36 1,60 


1.21 


44H 


FXCFLLFNT 


70»96 Oi69 I. II 


0.65 


m 


CfHX) 


66«?l U2? -3i65l 


I.OI 


59? 


AVERAGE 


70,77 1.46 0,92 


K53 


50 


FAIR 


OiO A,0 -69.a^t 


0,60 


0 


POOR 


— ATTE/)nANC6 FIRST OUARTFR 
' n.93 -2,U* 




m 


LOW 


0,59 


lOhl 


72i49 0«60 2i6M 


M2 


951 


HICM 


— ATTENDANCE SECOND QUARItll 








OiB? 


MO 


LOW^ 


71.64 0,60 U79I 




1150 


HIGH 



P*VALU^ 
I 20 3| 4 1 5j 6| 



MMMMMMMM4MIMMt4M4M4M4$ 



\ 



IMIMMMIMfMMMlMMItMMIMMI 
|MMIIIM4l4l4l4l44t44IMIMMilM4 
IMMMMIMIMMIMtMMMMMIMM 



mimmmmm4mmmJimmimmmmI»i 

IMMMMMMMMM«MIMMMIMM«|I 
MMMMIMMMMM4MM/l'Ml>MMMMt 



1... 



MMMMtMtMltMMfMMMMMMIM 
MMMMMMMMM4IMMMMIMIMM, 



MMMMMM4MMMMMMMMMMM 



IMMMMMMMMMMMMtMM ^ 



t4MtMtMM4M44tM4mMMtMI^MM 
4 



IM444M44M4MMM4444M4444M4II4M 



1 



MUdNAL tVnUAIION SYSTIMS* INC* - C0N1CN1 



ANALYSIS RV NtPOHflNO (.MHiPfi 

COD w UAff iiDS mm^ \m 



sr or 



fUlAL TEST SCOfiE 
C«OUP Sf or SAMPLE 



M-VALUr 


P'VALUt 


EFrtCI 


frrpcT 


t> 1 1 r 




0*67 




1 






rr in siuoFNT 










MilVI 












Of 


1124 


—-mw or THH 














34 


fc*tr 


I.M 






l^8 






iio:^^ 




I4?l 




0«57 




, 0«S3 


575 


N-Hi¥ on m mi about 


5CHrOL? 












131 




C.Wt 




0i74 




70.0^ 


ft#73 


-?#flit 


0*34 


740 


?4f^7 


0*M 


2*S2^ 


0*?7 


'960 


7?»H*) 


i.rv 


I.RO 




124 



HfiMFKOW * DRILL tow 

U*1f C»43 ' 2.7?5» 0*36 I07r 

(f^.i^O M7 -?teS4 0*67 ^3^ 

f9»74 Oi90 -2.314 b.!>li .ft76 

— HICiCWOPK - HfADING ASSICNCD MATtRlAL 

74>.V 2,284' 0.37 949 

71. M> . OiPl '-Of 35 0.33 H2I 
f?*H4 Of9^ -4.?t4 O.fiQ 420 

— *MOMf||()HK WRITING UN A;,bI&NEO TOPICS 

7lf:^ 1.25 *0t7D 1.12 113 

74.;(. rifd? 0*39 745 

70iVJ 0*77 -I. II 4 0.28 IJJI 

--•HOMFWOMK - VORK ON YOUR (UN 

^^77 Ifb7 -4.?A4 UI5 176 

70.17 1*16 HfOa4 0*66 JV6 

72. «f» 0f53 0.924 0.25 n»2l 



P-VALUt 



HEPfiMTiNC (Af%IP 
ALL STUDENTS 



MALE 
FfMALC 



9TH WADE 
lOlH GRAME 
IITH CRAK 
I2TH GRADE 



STRONfiY DISLIKF 
DISLINl^ 

SfMooL rs OK 

LIKL 

MRONCLY LIKF 



DAILY 

KEfKLY 

MIlNrHY 



lUlLY 

WCFKLY 

MCiNlHLY 



DAILY 

WEEKLY 

HPNTHIY 



DAILY 

•EEKLY 

HriNTHLY 



I l| 2| 3| ^1 ^1 ^ 'I ^1 ^1 



loo 



M4I4|4I$M4M4I4MI44M4I444444I44|| 
444M$44M44M4M444IMI44M444444II44 



4441444414444444441^44441 
444M44444444 44I4MM44$44444M 
II44444MM4M«44 4|(M44444)iM4 14410 4 
44444144444411144 4444M444II44M444444 

I, 

MM4444444IM444M444444444444444I 
4444444114444 444M444444$444444444M 
$444$4444444M4M4l44444444l4444M44 
4I44$IM44M44^444444$M4M4444444M4 4 
f«44|444$M44M4444 44M44440M4444MM 



4M444444444I4M4$$$$MMM444M44M4 4 
M4IM44M44iM4$444$IM44M44M444l 
4M444t4ll44l44l$<M4 44444444M$$4M 



$4MM444M4M4444I444MM44444444M44 
$M4«4$4M44M444444M$M4444M444M4 
4«444444M44M44$$444M444M444444$ | 



4M4444444444 4M44$44M$4M444M444M 

JMM$$44|4M4444444MM444444MM4444 

M4M444444^44444$M4M44M4«4M444I 



M44$$|4M44M4444M44IMM44444444 

4I4M444M44444444I444444M4444444M 

OMM444444M4444M44M4l4$MM44*M 



I 
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)■ 



•V 



'NATir^iAL tVALUAflON SYSUMSi ll^t - CONIFNF 
MASSACHU5F.11S STAUWlOr FDUCATIllNAL ASSfSSMfiNt 



ANALYSIS MY RrPORlING* GROUf'S 
C[)D 17 YCAH OLUS SPN)N0-I97H 



72, ii^ 



r.F (IF 
('.ft? 



in.TAL TfrST SCUHF 
GROUP GL If SAMPLfc 



1ALK{0 CAWtEW OR GUlOANCt COUNSELOR— 
7J«yj 0.56 OiL'7 IJ4r? 

lALKtO PARENT 

7i'iM C.frl *Oiir • 1967. , 

fif!#73 l#l!> 0»7P 2|2 

TLAKtO dlTH FRIEND 
7'2.flr •o.'fiO ,0*77*, 0.17 IB70 
rV.09 I.OH -2.95t 0»62 ,301 

— -ULKID WITH PERSON |N INTFRESTIN6 JOfl — 
7;'.;0 C.AO . 0*15 Oi.29. 1045 
?r»4| . C,»j6. 0.37 C.?0 1112 . 

TALKFl) WIIH THACHtR 
^.r3.7a 0.72 l«69« 0.29 . 610 
'71.43 . 0.64 -0*6?* 0.25 1350 

jJ--Oin YOU EVfR TAKE A CARFtR 1FST7 
74.02 O.bO ].m 0.39 1)23 

70.7^ o.Bfl -1.33* - (13 - an 

■ ('Pi4b 1.22 -3;594 0.03 260 



"-AttF FIFLD TRIPS USFFUL? 
72.49 0.61 0.444 O.IS v 1667 
70.72 1.08 -U33 0.;3 2)3 ' 

—SCHOOLING HELPS YOU THINK AUOUT WORK? 



70.03 
71.<t| 
73.42 
71.31 



0.77 
0«67 
0.9? 
1.16 



-2.01*^ 
-0.24 
l.3B<^ 
-6.74 



0.63 
0.25 
0.41 

-0.99 



269 

m? 

691 
174 



RrpOWTlNG GROUP 
ALL STlioWTS 



YFS 
NU 



YfS 



yii 



YFS 
NO 



YFS 
N(J 

I DON*r KNOW 



... i 



YfS 

NO 



NOT VERY USCFUL 
SOMEWHAT USEFUL 
VERY USEFUL 
I DON'T KNOW 



P-VALUI 

II 10 20 30 40 bO 60 fO BO 90 100 

.,..l|f.|.|..f.|l««.|.l«f|...l|.f..|.*..|.i..|.... 



M444MIM44MM4M«4l|^4 4IM4p«444) 



4444M444IM4M4M444«444M4M$^4$$$4 
MM44MIM4M4M44M4$44M4MM4M4 

|m$M44IM4\i4M44IMM444M444M44« 
M444««4MII4$4M$M4«44MMMM444 



M44«444*4$«4M4M444M44«4*M44M$t 
«M44444M4M«M444MM$t4M*M$4M« 



II44m44M«MH44M44M44$M4444M4^ 
$«M4$4$444M4M«4«444$444$M44«^4444 



M4444l4M44444M«$$4$M4t4#MMMMt 
MM4M44M'M«4M^4i444M4«$M4$#444<l 



MM44444$4M4lil4$4444$44M4M44444M 
$«$M4*4M44M«MMt4M44M4*44$«44« 
*M«IMMIM4$m4f4M«M44«04444M 



MM4M4444*4444M«4«4I$44M$M44M4$ 
$«MM44444M4M44«t44IMM4*44M4f$ 



«$««M«4M$4«M44444I4444 4M«4444M4 

MMM*44444M4M4$44444444$|4«444$$M«^ 
*M4M4«44444444M4444i^4M4MMM4«M 
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HkMmi KVALUMION SyMFMSi^HCi;- tONlfNT ANALYSIS MY MtPORIING mm 
MASSACHUSniS SIATFtrlDK fDiOIIONAL AS^iTSSMFNT COP IT UkU OLDS SPHrNO lV7f« 



rilTAL mi SCOPE 



P^VALIIF. 
7{ .05 



SE OP 
r-VA,LUt 

0.ft7 



WW, 



SC OF 
tFFECT 



SAMPtr 

Sl/F 
??01 



-HfN MUCH ART YHUN PARfNTS INVOLVED? 



70.h3 
7Mb 

7M4 



fli7A 
O.SS 



-I.A?< 

0*13 

o.n 

1. 10 



0*40 
0»59 



-^FAMILY 0CCUPA7IPN^L StATUS 



7?.J4 
7?.bfti 
fi9.l^ 
67.?, ^ 



O.bl 
, 0»5fr 
,M.04 

?t24 



I.0V4 

r.5i 

-?.934 

-4.a?4 



0*23 
0i40 

0. P7 

i.4n 

1. ((3 



406 
72P 
734 

229 



IU^ 

Ml, 
151 
Ma 



-—DO YOU WANT A JOP LISTtD IN^UUFSTION Ifl7- 

73.07 ;A.aft. i.o?v ^0.31 i?ia 

70.10 b.6b Oi47 
'7np.1 .Oi/72 -0.?2 04ftl M7 

-"dl» YOU «*Nt A JOB LlSttll) IN UUEMION ?0?- 
67.bn' |i.V6 -4*164 0.47 70(> 
74. ,U* 2.284 0.30 1146 

n.H Oia? uoo o'.bH ^343 



— -nu YOU 'want 
64 .(^^ i.sr 

7i»«V4 0.63 
6M.h 0.99 



JOB LiSTf.D IN .0UFS110N ???- 
2^.1)4 l.0<) 160 

o.a9»^ 0.14 ia3a 

-2.904 0>7B 199 



SURF ARf YOU ABOUl FUTURE JDB7 



7Wf)0 



0.7ft 
0.67 



-0.55 
0.30 



0.43 
0.24 



472 
94a 



RFPOMnN<. GROUP 

.J 

ALL SlUOtNTS 



MAROLY AT ALL 
, ONLY A LITILE 

ouiTF A pn 

A LOT 



MfOIUM 
' LOW 
' UWKNOWNjl , 

um J 

• I DONM KNOW 



VIS 

HI) 

I DONM KNOW 



YES 

Nr 

r DON'T KNOW 

, \ 

NOT VFRY SURE 
ffiMFWHAT SURE 



Tl.Vfl O.AI . 


-0.07 ,0.35 


777 




vtnr SURE 


• — PAdCNlS IfANT 


YOU 10 00 TO cod 


.FCE7 




* r 


fiS.HO ' 6.93 


-6.244 O.VS 


17V 




HAKDLY AT ALL 


67i.r> 0.7a 


•4.694 0.54 


33^ 




OMY 1 LITILE ^ 


C.65 


Or04 0^32 


764 




QUITE A PIT, 


7twOa 0.73 


' 3.034 (1.3? 


9oa 


■ * 


A LOT 



-<fHM oy YOU PLAN TO 007 



('6.46 


M2 


-5.^)94 


0.60 


315 


FULL-TIME JOB . 




1.33 


-3.fl4» 


0.9a 


111 


JCH-SCMOPl 


6M1 




-2.644 


Oi76 


257 


. ^mUk TIWlNlNt. 


71.73 


> 0.70 


-0.31 


0.7b 


211 


2-YrAR COLlEfiF 


77.i)a 


0.42 


S.23» 


0.44 


aai 


4-yt:ar CfiCF<;i: 


67.79 


0,90 


-4,?6« 


0.S6 


39e 


PCNM KNOW 



P-VALUt 



1 1 2| 3| 4| $1 ()| 7j 60 V| 190 
M4mMflfM4M4MMMjl4VMrMMI 



M44444M4f4M4$IM44M4M4MM4M4 
fMM4M4«MMtM4M4404«4f 11444044 
M^4$M«4f44M4f4444Mn444tM444«4M 
MM4f4MfM«M«MM4MM4M4M4M4«4l 



M4M4l>M«MM«44MMM44Mt4l4«4m 
MMMMM4MMM444$«MM4«44#MM« 
M404M4iMM4M44«MfM«444M4MI 
$M4MMMi44M44«M4#«MHMMM4 



^M4««««IM4lflimMt4«4«44«4«4$44«IM 
MM4444IMMM444M4MMf«M444«M4| 
M«M4M04IMM4M44444M4MMm449 



M44M44MMM44MI4M4M4IMM4IM 
M44M4M44044MI44tO44M44044M4M 
4M44M4M44Mi4444M4MM4MMM«4«44 



tM4««4M44l*MMM4l4MM4M4«4« 
M4M444M$M4$IM4IMMIMMM4MtM 
MM*M444$M4404M4IM««>«4«MMII 



IMr40MIHMOMM4M44|MM4MM4 
M44t444HI4MM444IMM444l4M4M4l4 
OMMI4$44MM4«t444»MMMM4«Ml||« i 



>4MMI44M44I4IM4IMM4444444M| 
l444M44MM44M4M«4M4MM4nMM 
«|$IM44M44«l4$l44lM4«MM4M4MMf 
«M*4^44M4M4M«4Mt4MM44444444MM« 



M4!lMM40M44MM4tM*l»M4M444« 
M*4M44Mt44M«44«44«M4«M««44l4« 
OMMm444M44444#M44lilt4M4«M4M 
4MM4M4«M404M4M«44M44M«4#40« 
1|«M44«««44#t«M««Mtlt4M«««4$«t$M««l4 
IM«»«M44^MM«4«M«4Mt$«««M4M4 | 
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, MiltWAL !VAHMTION.$yStFMS, INC. •- CONlPNT ANALYSIS BY WPW1IN6 CROUPS 
HASSACHUSCT1S SlAtFDIDE FDUCATIONAL AiiSFSSMENT CUD ,17'YEAM OlOS SPRIN(, 1976 
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Massachusetts Statewide Educational Assessment 1977-78 * 
CODING INSTRUCTIONS FOR TESl IN CAREEft AND - 
OCCUPATIONAL DEVELOPMENT 




Twelve of the test questions on the COD ;test were "open-ended,''' rather . 
than muljiple-cholce Items. On these Items the student had to write in 
,the correct answer. On the fbllowlng pages are the guidelines 'used by 
NES tD score those Items, and a key to the code used for each type of 
response. ' • ' , 'V * . 

The guidelines used for scoring were .developed for use in the National 
Assessment of Educational Progress- (NAEP). By using the same gutdel.in^s, 
we Ijave assured that the Massachusetts results are comparable to those Qt'iit 
NAEP. " • ^. . 

. - ■ ' / 

.The next two pages contain the code numbers for ejijfh' type of response.- ~ 

For example, on Item #4,*a score of 3 was giv^en^a, student wfio made only 3 ' 
.acceptable responses to*the question. The niaVtery cri fe'ri on indicated 'fw 
■Item #4 in Appendix A Is S. which means t^^^ the student had t6 write 5^.]^^ 

acceptable answers to be given credit for the question^ , 

Examples of acceptable and unacceptable responses 4ippear on the remaining 
pages of this appendix." >: • * 
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ITEM NUMBER, 

. 4 . 



NES CODE 
2 

.• 3. ■■ 
2 . 



RESPONSE 



No response 
One correct respon-se 
Two coT^rect responses 
Three correct responses 
Four correct responses 
" Five corrfect responses 



No response . 

.Machinist, metal engineer, etc.^ 
Incorrect response ' ' 



ERIC 



f 




0 ^ 

2 



>5 

1' 



1 

2 



-Vrr: - 4<v res po ns e 

Architect, etcr 
Incorrect respansed 



No response ' • ; ' • . 
Bank teller., cashier, etc. ^ 
Incorrect resfjpnse ' . 

V No response , 
One correc>response 
Two co.rrefct responses 
Three or more correct responses 



■ .V • ■ 

No response ' 
.58, 59, 60, 61, or 62 
Incorrect response 



No response . 
88,^89, 9Q, 9^ .or ^ 
Incprrect response 

... '.' " ■ . 

Nq response 

73, 74, 75, 76, or 7: 

liicorrect response 



J 



A. 
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ITEM NUMBER 



NES CODE 



RESPONSE 



/ 

81 K No response 

1 10 or 14 - 4 

2 Incorrect response (for example, 4) 

'.']'. '-^ ■ 

82 ' . )4 No response 

7 1 J 12 or 28 - 16 

* « 2 Incorrect response (for example, 16) 



83 ^j) No response . 

1 120, 12 X 10, 12 by 10„ (12) (10) 
'r ' ^ OR if student correctly^ 

s multiplies his answers to 81 

« * and 82 (for examp]e»64) . ^ >^ 

2 Incorrect respons'fe' 



89 J . ' Each of the six components of the . 

envelope are scored ^either correct 
or incorrect. The six components 
are the three lines for the return 
address, ano^the three lines for the 
, •'. address. t\ ' • * 

Ji . No response or all incorrect 

1 One component cowrect 

2 Two -components correct 

3 Three components cqrrect 

4 • Four components correct 

5 Five components correct 

t 6 All six components correct 



QUESTION 4 — ACCEPTABLE RESPONSES 



■liroiiiitLirf, cikLLtiiai, mtrumst. siir-iinomtit 

■«• k« can kmiM in • cartcin culd 

tf irl«A b« r«tlt«t can ist concricutad eowa ftnoaladqt or tuilX 

ft* if Ik* mmtk IM 

tbiM U !!*• t«|> kard or aiiT 

tl tk« lok cftti frai^ pao^ia in anr vaT 

•lii it kaly atkar p«o9ia 

1«k tkat coilA ba ineraaaUf foar inoaiad^a of tha 1o» 
S6»atklfi4 vitkovt praaaita ' 

iktt banaflt te'atkara ia ti / 

Tbaf tkanid ki>o» if tka loto ia aaav " 

Raw kir4' it.tka »arkr 

It It «n iiitaiia«taai cAaiian«a 

nitural taianta tn4 tailitiaa 
«ill ?«a caatinva to laacn vkiia vn tta iob 



Find oat a iittla «koat vaat tkay do 

*rTM of «orK 

•lat kind cf lob 

ak^t do TOO do 

90 Z kata to daaa ?a«9la 

•kat Toa kata to votk an , 

Maat vatk Ton kata to do 

Ho akoai4 knoa luat %ov MtCA work ka «iil kata ta do 

la akoaid knoa afl«CtiT vkat kia (<inction voald ka akan aackin^ 

Taa tkinaa Taa aiil ka doim 

Vkat kind of vork ko vanta to do • 

Tkav akaald knoa vkat kind 9f vock tkaf «ra vainq to da 

kll tkat )ob antaiia 

•TfP* of aark ko*li bo doinq. 

TTM of 1oi 



rs*«3ikL SkT:sricT:oi, mriifsr, sisiirs ci aokis 

Vkat kind of wort ka iikaa 
NOV vail TOO lika taa lob 

Kaat ta Iikaa to do kaat ' 
, naat ka «ill ^at Mtiafiction troa 
Vaat ki voaid anjet doina 

la okottld «aka sar« vni find tna pkrticoiiC c«r*a( rtvacdin? 

inraodf saoald tktRk 4»oat it kv «int« to bt ona or not 

90 voa iika tka kind of «ort voi ttni \o 

«kat kind of «ork roa'ra intaraatad dk 

vaat aa is intaraatad in « 

:e a saraon onlora taa lok I 

••at do voa iika. rou onoMld atvo in intaffvat in*«ft*t yovi'ca laina 

in latar iifa 
la tkit vaat aa wants to do in tka futacal 
:j ka ««ln« to atay «itk taa lob lonq ^ 
Hia or bar aaaainaaa \ t ■ 

■la or bar srafaranea 
' It It vkat fa« vtAt to do' 
■Ofto'a intataats* ' ' 

Tia aatiaf action ona viU racaivt in 4oin4 tao lor vail . 

caooao aoaatairia vmo iika 

«iU k« actttklir lika tka '*ob tain^ aouoat* 

XI sboaii ba a 19D ttat voa ar* ;ntaffaatad in 

Is tka icai of intaraa>i to foa 

Inlofsant of iob / 



fmww 



i?kxm. 



oyvoaTOVZTT roa kOfkbCiaiaT, 



TkalLXTT 



• luricTk 

^ »*• ?©«ltlon !•» in \ 

If itrafU «Ava kin aaaarianea ao ka can ^at a iitfarant lob 
»bat aa cm ^o for kiawalC aitk a parttcvlM lok * 
.ba f«Mra ba la 4oiB« to bavo it.ka' vorks tkara 
ffkan m¥ a ill bo atota to qat a raiaa or arpooUon or botk 
Otkor ,^osia*a ofin&on \ ' 

Xa tkoro rooa to aoao at ^ 

:*,tka )o» or earoor ono tkat foa ckint voa.eaa oako it to tko too 
Piituro if any in ti« tiaid, abaacas fat tdakneoMnt 
Ikat ataar fiaiia of vatk it coald laad \o 
laatkar ar not tka co^aanT ia araaina 

Ckknca for t1rprovo*ant I » 

Ia tkara an^caoo for bottafin^ yooraalf ' 
idtaMOMt pot«fltici ^ 
rba sraapoct of iro^wtioii Ia lobo 
aoa faat can ka ottoct adfancamit 

iatarallf, ia tkatr a ckaAca foe adVancaoom aftar ao aanv taara*^ 
can Toa battar voaraalf :atar. 
Ia tkora raoa far adtancaaont 



kti:.kaii;z?r ((fitsm kaD rirtoazi ot Tat JOa 

nnd sat if tkara ia^anV cojipatltian ' 
ic akooid bo aoMtbinq tbat offara a fatara 
bra taara ano««a ioba of tba« kind 
doa laiH aiil it lakt 
laa iofif dooa ka tkink bo* 11 ata? tkora 
Boa aant oaonin^a ora taara in taat Hrticalaf flald 
fatara 



loiciii conitioas, atcivxcAL kSHcrs or job 

■OMT ^ 

loa M«k tbof poT koo' 
laa MOT 4oTS ka baa to aork * 
too MOT 4oTa ka «ato of< 
akick kolid«Ta ko qata 
Vlon atU UoT atart tkal« jab 
ttat tlao vill tkor «o im 
ibot tlM oill tkoT «ot o<f 
loa oock Maaf t*o lot aiil fi 
It ko oto paid foe koiidofa 
it ka Ota paid <or «a«btioo 
Tko aoT voa'ra «oia« to to oork 
too oaek it ia ^oioq to toko for qaa 
U ro« eta ««t abJkt sbift rBt Mt 
lOa MCA Maar m«4 to aoko a UtiM 
■fa mmnj koara t** vont to oork aacb dar 
too oonr keoro ko kba to aoct 
atll Z ko kOM a<to« ^ > ^ 

till X koto to vort oaar tlM 
im it naaf Toa ^ 
Sa it dOAfareoa 

fill It MV <or boapital parMota - inauanca 

nil it paT for bMafita ) 

fill it bav faa to qat tkara. 

loa oftM do Too 4ot >aid 

loa MCk Mnor doaa ba vant to «ot paid 

Tka kooro voa Mrb 

loa aack Mnav aA boar 

toor bMOiits 

Loaek ktMk 
' Vocation, ka al^kt kaaa to Mfo 

Hat baasa ka«a «orkla«, it Mi^bt affact kia fasdlr 

farklo^ eooditioM 

toa MCb of kia tlM doaaja aant to firo ta doiof a ^ob . 

Tiaa tot ktMka 

letantlal Mlarf 
j^aotkinf eoAdltioaa 
^KiMo bonhfiu 
^rocation 

Tka tMant of tlM ro^airod ia a lo* 

Pmll ttaa Mtt 



aorkla« coodlUo^oa aock aa la a kiaat la kad acid fiaoa . 
Ttm ot aqaiMaat for kia om 

TM fiaanciil 4a poet at xkiM coCMt ooold it ka a ^ood LiTia4« 
doUac-aiM* 

BMa it of foe artivitiaa or yrotrau for otbor aMboro of bis ftailv 



focmritr 

:f tkof* 

la taa 1 

iav ckM 
laoalkt 
f takilitf 
Stakiiitf 
^oaaibia 



^4od to lo tbbo tfM of ioa 
iklo 

fottiA« ioid off 



'tar 




.^dtb of 1ab bofora aatoMtion 

■4i JSil •r*'*** *• ^ • f •» i»4in«aaUHraiaod in tka araa 

a* lilt Off Oot * 
abotkaf tboro ia lot MCbCitv 
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QUESTION 4 - ACCEPTABLE RESPONSES (continued) 



JOI O^AUMcAtlOII (rtilllM. 'lUltSIICI* lOOCllXOll 

It Xhmf •111 M««<ife« 

ft» TM n—4 tr«LnLn« 

Do To« t» « 4ipL»M 

ftt* l»n4 k«« »««n In •cfeooi 

!• iioild «A0» feov dlfflevli tfet va to M vlll fettt %km tkilia fe^ 

X( Xkmf k«t« to M to ttoiloffl 
If feo feto •location to fo into tU (i^Li 

Vfeai ftio boon tctiAo4 to d« 

^rrtflooA >o»o 

It ik»«Jld M«oi «fett 10 10 rofa(C«< to knoo 
It fco Uo tfco te«Lnin« (or tfeo 'lofe 
9of Meh ichoalln« or boo bad 
lot Mri triinin^ aiXI lo n««d 
rrilnino ibat Toa •■?• lad for tbo job 

lo« Buci •dnCiiLon r»«'l &ooi mnd it foo coold eo^a «itb it 
ra«C rH«ict»oAto 
Tbo o*o«nt ot ftCbooiino t«<«iro4 
ScboollM nocooobff 

Cin b« soot tbo odicationil roooiroaooto 

!• tbo \ob eoAbiitont viib voot iriioin* tnd oiMr^^n«o 
Oppott«fiitr for odacttion Cor iob 



QTiii iccirriiLt itipoitn 

U T«t febtt • «bild •% kmm ' t 
It ii* 'Kt fOJitt bui tb itfo tbo Hi 
l« bti to tbink 9t !!• f«»llf 

Oe vol kifi • btbTblttir ^ 

If r4«*ri d«U4 t« ocbeel, vlll It lntorf«Co •ith oto4loo 

Ibit btboc loli aro •fillabio 

Vbit kind of Coiititldn doii tbi ^liCi bi«« 

Tbb lol'« ■ffoct on roir liCoi 

licitil ititib (Haaiilal 

X( T*i ata Pltnninf • fboIlT booo 

Xf it int«ef«ro« vitb otb«r MtirLtio^ 

!f it koopi fof tpbCt CrM r»dc Uallf 

i*Milf C*^lindb 

lirliil otbtM ^ 

•ilitbrr atotia 

liU tbi )«b Lntorfdco «ltk kit bo»o lif« or ootoida inttrosto 
eia»btUio wLt^ ootiido La/litnCio. L.o.t f«aliT lif or rolifiooa 
liio 



?IISOIIL IblLXtlKS ai CSfSTIIlirt 1 ItTtLLXa ItCI • 

kiitiT;iit 



ruioiiLiri. riTsxCbt 



•ii bMitb 

ikotbor •( not bo con do \kn lok 

lo» toll foa Cin do »bit too aonc to do 

If It Lb k^d vori and tUoo oooilp daind it 

till to ibo do tbia ^0 •oll7 

tf tboT tklnk tkiT ekn do it 

10 bbio to i^ort bard 

' tkit lop roa ara boot aalt*d Cor 
Ibat bii ParUcilar talant or aati^ado io 
C4n tkof itick bitk Lt or not 
If fov «ra aaart onoaoa 

11 It too oack for ras ta do (taioa ail foar tloo to do food joO> 
.Ikkl can Toi do vaLli roa kkooid »iek a lob tbat ian't to« diffieolt 

nor tM oaaT 
O.to's. ciPabiUtT ta do tb« vork 
dopi^ia iLka t» «ork 
ze ta tbinka bo tun tko lob 

aoPi ko roallr kata tbo luao ta pat Cortb tbo aCCort 
vHo't talaoko 

Cbooio lOMtkln^ ?oi*ro ««od at 

Skoald fia conaldarod vbatbor tbo poroon kao tbo abllitr is ata? «itb 
tka cjcaoc 

It fo« ein sund tka ttpa of latoor - phTaLcal and a«ntol 
aoM tb« varion baft tka ftontal OMkili^T 
Ibotbor ko till or vo^t't bo tblo to kandlo tbo lob 



riTllMlSOIkl, llLkTIOII 

■oo voll foa Ilka tbo ro«»lo 

fill bo or ooo w Blan< «o«d vitb otbor mkorof 

«oo tbOT Mill bo aorkinf vitb 

aoa do X act in front of otbor f«opi« 

■bot Toor bo BO oon ia Lik%' 

kbit tba poopla iro liko* > 

Tka MnaqoMnt 

lo« vlll ao 9at olon* «itb tb« bora and otbor onoloyooo 
Ibo TOO vorft oith 

Sanofflaco «boro taar troot foo «ood 

la it an oppartanitr to noot poepio foo oa1or boinf altA 

tkat kind of poopio tbof aaat to soot 

pooplo ba vlll b«-vorkifH| an«or 

Ittltadaa of otboro tbat ono aoot oork aitb 

;9*»«rtoro 

SiPorvlooro - abilitT to oo^k oit^ tbna 
Pica pooola to vork vitb 
Tfpo of pooplo bo viu bnaoeioto pitb 
Tilantad atkff ntb tbicb to aork 
kasoetation vitb otboro 

POSSrSLl 3ISClXllaktdlT PICTOU 
k4a ILnita 

9« oboold tklAk aboat koa old bo lo 

Pill r ba birad rvon tkoo<b X an a dlffarant aat, rae<)s«r rflidio* 

•kotbor or not tko Pooplo aoeopt poor caeo ^ 

ioo 

loliflooo eenoietiontf 

Xo it opon to all pioorttiooT 

Ibocbat tba coapoDT ia an o^ooi opportooitf o«ylor«r 

* ! 

ITIICAL COaSXSIunOkl 

Tbo Udolitr of tbo 10b 

39oa tt ^rodaco prodasta tbft fO to por 

Iff it a lob taot flto bio otbieo 

■ill it bar« ooiMbodp oino noMloMly tb«i too onold 4o aoMtbinn 
olon 

rf its lo««l « 
Sooo fo«r lob bolp or h«rk otbor pmplm 

•ill bko lob controet bo trotbftl in tbin^o liko raiMo orotf 1 

noocbo i vook vaeacioa« ore. 
7ooa bart otbor ponplo 

9ooa tb« aork eoftfliet aitb bor 0rinri»iM or •olooo 
no lob OA tbo Lotoi 

•opoiotiofi of eonpoAf poo ba«o lAtnntlTnn to onrk*lnc 
ta tbort ooMtbiiif tkot OM^t CMoo toofo by yoUatiat tbo *ic 
•r ootor 

In tbo oork k«n««« ^ . 



UNACCEPTABLE RESPONSES 



OTIta QlkCCIffiftll llSPObSiS 

tf tbar vill braak avt in a roac or m% 
Oraosod Ptoparlr 
Ttpo lob 

Tbini 11 itia 9aod anai^b ta k«to 

91^1 X nood workorr 

Tbo kind Of ofoipMit 

rat nooot in tbo book 

Do X «oc in crooblo 

Con I Clobt 

•opolloo 

Ta bo rollod on % 
It bo aill fot In fiobta 
■bat aro roa doind to do titb t^o oonor 
Tba eontroct of tbo ~' 
If Toor fooily ovno 
Advontafoo 
DiOadaaJita^a 
la Toar kooo coco 



on lob Jte 
•oa la ba qainf to gat tbo }ak 
vkT k% ckoo^oo tbo 1«b 
l( rat kkvo eonnoctiona 
Xf tka 10b ia food or not 
Xf tba vork io good 
tk« XiailT 



IXIC7 DorixciTi OP i pitfTtoos ilspopsi 



jtiZsTi^PBXTS goiSTXoa 

8aP0 • dood pducation 

Ba voll oannarad 

■a satlont 

•avo 9ood oToo 

MOOd Bockdroond 

■aot bo ailXind ,to vork bard 

•o a oocbonie 

•o an a£tor 

lock in a otoro 

•ao iMcblnoa 

Plbf baaoboli 

■o aboald tblAk aboat vaat bo konta to do 
Talk It opor vitb aonoona 
Sat atbara apiniona 
to 



at atbora apiniona ajM la 
ov to talk to cbo ooflRo. 
o aaodlaa, «iPon f^^k 



ko diaaqraofl aitb tban 
3on»t t«cT 9«naro«o 



eiiiidt 
lot 

To bo aklo to 

Cbanolin 

poaaioor 

to aanploo tifon 
la aanploo diT«n 
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Q # 



ACCEPTABLE 



icciffuu utmsit 



UNACCEPTABLE 



9iACCIfTlltl lllKUIt 
lOMWft&Xa ■•rfttr 

?▼ r«MiaM 

iMlMUaX ••lUt 

IrtltMii 
C«iit«««t«f 

r«««t«r Mrktr 
fXMtor 

■•«aX Mr« «u«c 

XttM •Mr«t«r 
IMfe&nt t«MM nan 
TmI mi« «t« Mfe'«C ^ 
T—l «Miffl«t 



) 



KCmifU ftllOMU 



( 



aiiccm&iLi iiiioifii 

C««M«X«C 

••X1I1A4 *«iiM«««lt 



M» t« Mill MU4Uif 



KcffTtiu iitroun 

•tut t«lX«r 

T«XX«e . 

MBJi cXtrk . 
CatfeUi la h%mU 



aiiccimtu iMVOitis 

mratarr 

iirXiaa koatM* 
Cfe««i ««t UO 
MM 

Clarft 

l«X«MMi 

■••ksc «f ua lali* 

Ciaetor ^ 

itat attmteiit 

lA • kMifc 
••cratarr 
■Ml «i«ck«r 
iMik e«U*ct¥r 
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QUESTION 26 - ACCEPTABLE RESPONSES 



cevMiLQii iDfiMi4 aoxuKt orrici 

4« to C|« a«t«M« offU«r. Tkmf ■•f« ImU mi 
Urn Mt 4mi6mnf cotfnaalvt 

20 t9 tmm lofe tm—mtem cMi«t in •■t msmI iaarnin^ ««ntar 

:»ali ••. t9 f99t eennMloc tM lai f«f ■tfaia* on ifeo lob 

*Ltkt «ao oacaac cantor in aeboot 

)ot iAforMtlon Croa tka qaitfanca offico 

taU to tfea eoianaoloc 

Tait to a ■to4ant a«aiaot 

rail f t lak ^anaaioE 



j:c9fi;:Qi iicirr :tiiti ^i*iMixii> 



(III ■iirioa or sricxric 



i<i titct to MO vaat kt'a liaa 

;toQil tl«t toci laara 
:: fOvi tnoa » vacaon in « 9ii»inaio tfelk to feia or me 

iov *nior taa lag fan aca irkiotaato« in 

*^ I'i ta« e((ica, (*ctdrT or mni mo tio loo baanq aarforMd 

. tSiiiJ «o le • >ac»an iiat 4mo taat klii4 o( «oc* an4 ooi 
inf ar.-^it ior> 

iJ «i« i aonfeac le tM jnton an4 4oi infoCMtlon 
10 p«aai« .lo k«f« ttainino 

Malt « oU<t vMra tawc inttctst ii «n« taik to pMflo tkaro 

to Mopio iM k«fo aatn ■•toelato4 «4tk tko )ofe 
nait tia Piaca to i«o io. iftin^a »fo 4of«o an« ii foo ata GipaOla o( 

lOino It 



9t7tll *iO/OI JIIAO felTlltIt HOOT XT 



kt 'JO in tfeo «nCTCleo«4ia { 
bcoc«oca« or moo LnCorsation eilL4j|it lofe 



^t acoc«oco« or moo inCoraiatiar oitL^ii lak ^ 
loot in tfeot loa aanool 
laaa 4m on tfea Ixtaratoto of tM loa 

3a to tko Uaracv Xot intocnation an la««tk of tra&iiiM* Pat. otc . 
Sona aaa? foe »oo«Uta «Mot it ' 
Caact tao ftoatnaaa financial rocar« ind otkot MCkaroonl bv aaiM 
tft«t noo Ida infoc^ation canto^ ■ ~ 

>oa« «atackala« panpalata. ^tocMraa ate. 9a tM 1o» 
■ao4. in i liorarT toi araofla. fatotiai Goococaln« foot lob iniocoai 
taaaarca in tba libtarf 

Roaaarcb otaot looo tog tbo paM ol tfopMClaon 
(S-i te *M roao<«Cco cantar 

Sani to L&kraCT aaiociotiono 
rfCito a«a? io tbo caLIooo tfeat baa narsln^ 
■cita a lottor to taa coLiagoa of tbai acao 
^ioca • coLIooa c«t«Lo9 

C»o<t titfe tM soila^oa u tPo acai tni feaay taoa Mnd aaoPblata 
rtcita u "C«:«aco" m Vaaainqton 

/tito 10 4 tioiroraxtf ac tocanical acbooi foor iaa^? Portain to 

'*Li ?o i^io<<:.Ti«ctfit HOT :j sricirtc rxxLfl) 

« toacbot 

:n^«lC« fcoo Toac toacftaca, and .aAt tior i».vn« of tbat 

pacticalor lop 
rait to taacbar . 

7ai« to tooGMCK anl fin4 oiit Ma Uaf fohl «poot It 

wOiTtc? »u30«pu omcsi. tipLoiii 01 iipLdraiiT orrtcx ^ 

<clta • zattor to tao »4no40r of tpo im^ct 'or factor?, ate. 

to puea ;.rtocaPta'l in. in« a«l /o«e fuoatxona 
•o to frho nona^or ind aat aia aooo U taa triininu fot* aiii tafo to 
«o tMoooa ' 



* Sniu'" *** aa« t|o oana^ar a*««t tM pat mrt 

i 



'Pi(i.to to tfeo «PPponf M aaft too* cboot it 
Tait to p^.^ao; %^mt tbo lot 
•* to. tfeo ^mmti^wwmni ofCiCo and laa 



I . 

ofni 4ccm«iu itivoMu 

4ok tbo ^ataato If tbof kaao ambU« atoat tbo loft 
Uim a cloft aocb aa r»b 

bM a (tiond •t aaaoeiata it tMf bnoo anrtbinf a*ot it 
froa tbo ftottat ftaiiaooa ftatMf 
loteb mm M It 
Itlto (ot UCvraatlMi 

Call t^a lottat laaiaooo locoaa ta flA4 oat ahoot tbatt «co4tto 
h»k tbo ovtk oppotiawa oCCU* If tbof Pmb »nTtUil« aft*at U 
t^ab to an atalt, a««b aa t««c HtoMo 
ToU (o e««r«tln«> toManioa 



«4III«K 




UNACCEPTABLE RESPONSES 



To bjMo^o loft 
•o aaoilM «lv«« 



OTIil Ql4CCirTIUl iiiroiiii 

Miob aoftoal (inia* * 
Itaf foot 

look icoaM tntf mo 
rtoa a fclond 

Ikaa roi akat tko lak la all iMot 
kok oEoand tka coManltT ab«at tb« loft 
Talk to anotkoc poroon 
lotkiao 



ei? joi fli Tikxixi« 

Tr? to fo^^ork tkoro and aaa poo yo« liio it 
Tif 1| ?oorMl< 
nUd t Mold pclctlco on tko iok ta m koo^it MCt^ 
Sto4Y M ?«o coa do it Mil 
So t^a tcada ocbaol 
VockUio altk a oatMAkoff /V 
00 to eoilo^a 




raka 1 
Tako a clooo 



it 



IXSXgTtlPilTI Qoiirxoi 



t find oat akoto it La 

riad oat tfiat koaCtt Ma ata to «o to aack and eooa ko«« 
ffoa aack nono? toa ,oald lot . 
tak vaan atatt . u 

Pkat la?f foo aata off (liko koiido?a» 

ua< ;::MaT:c::::i:r ^- ' »-^'t.tion 

•batVlao foojpot.off ' , 

BoltiklMfs M< Maid work 
data a iro«< / 
Imaliko ' > 

Kmo kea tko pipca ia raa 

llaCT OOriXCkTI O^k fllVXOOS llitOaSl ^ 

« 

X DOi'T IkOa 



< 
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QUESTION 89 > 

— — y . 




3 ^ 

Acceptable - 

y Responses 
— — , ^ , . _ „ ■ — ^ 


Unacceptable ^ 
Responses 


/ RETURN .NAME 


Dale Roberts (plus Mr., Dr., etc.) 
0. Roberts 
1 D. R. 

! Dale Allen Roberts 
i Name not in exercise 

. — ^ , , 


John Way ^ 
Wrong place on 
envelope 


RETURN ADDRESS 

• 

. 


1545 Lake St, 
1545 Lake Blvd. 
1545 Lake 
bake St. 

Careless error on 4545 
Address not in e/ercise 


345 Moosa / 
Wrong place / 


RETURN CITY | Narka , Kansas 66960 
j (Ka. or Kan. is OK) 
1 (City and state may be \ 
1 on different lines) \ 
j Narka, Kansas 

1 Narka, Kansas 66096 (etc.) 

j 66960 (zip only is OK) 

jCity, state and zip not in exercize 


Nome, Alaska 99762 
Wrong place 


NAME , jjohn Way (plus Mr., Dr., etc\') 
X j J. Way, John M. Way 
^ * . I John Wayne -A. 

i Name not in exercise 

1- 


Dale ftt^Sert^ 
^rong place 


ADDRESS 1 

. ^ L 


345 Moose (St.. Ave.) 
Moose St. , 
Careless error on 345 [ 
Address not in exercise |i 


1545 Lke St. 
Wrong Place 



CITY. STATE, ZIP 



(Ak. is OK) 



ERIC 



99762 

(City and state iLy be; 

on different li/ies) 
Partial information, but letter / 
could be sent: 
99762 only 
Nome, Alaska 
• Nome, Alaska 99772 
City, state and zip not in exercise 

: 

390 



Narka, Kansas 66960 
Wrong place 
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